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GLOSSARY  OP  TERMS 


AFR 

DSARC 

Hit  Matrix 
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MDC 

MMHPFH 

POMO 

PSR 

Skill  Level 

Sortie 

TAC 

Task  Time 


Air  Fore*  Regulation 

Defense  Systems  Acquisition  Review 
Council 

An  analysis  tool  in  LCOM  that  gives 
the  number  of  times  during  a  simula¬ 
tion  that  any  particular  task  or  mal¬ 
function  occurred. 

Logistics  Composite  Model.  A  large 
scale  discrete  state  digital  computer 
simulation  framework  to  analyse 
number  of  aircraft,  personnel,  spare 
parts,  and  support  equipment. 

Maintenance  Data  Collection.  A  system 
whereby  aircraft  maintenance  data  is 
collected  and  maintained. 

Maintenance  Manhours  Per  Flying  Hour. 
The  number  of  manhours  of  maintenance 
required  for  each  hour  that  an  air¬ 
craft  flies. 

Production  Oriented  Maintenance  Organi¬ 
zation. 

Performance  Summary  Report 

A  number  which  relates  to  the  ex¬ 
perience  or  job  knowledge  of  Air  Force 
personnel. 

One  aircraft  flight  as  defined  to  in¬ 
clude  one  take  off  and  one  full  stop 
landing. 

Tactical  Air  Command 

The  elapsed  time  for  a  particular  ele¬ 
ment  of  work  to  be  accomplished. 


TMULT 


Work  Cantor 


wuc 


Constrained 

Model 


A  term  used  in  LCOM  to  describe  the 
process*  of  multiplying  every  task  time 
by  a  given  factor.  TMULT  ie  parti¬ 
cularly  useful  in  sensitivity  analysis. 

A  career  field  or  set  of  related 
career  field  that  make  up  a  work 
group  that  have  responsibility  for 
particular  maintenance  of  an  airoraft 
weapon  system. 

Work  Unit  Code.  An  alpha  numeric 
symbol  that  represents  a  particular 
system,  subsystem,  or  elemental  part 
on  an  aircraft. 

LCOM  An  LCOM  simulation  model  (run)  that 

has  a  limited  number  of  personnel  in 
designated  work  centers. 


CHAPTER  I 


INTRODUCTION 

Background  and  Research  Problem 

Approximately  60  percent  of  the  total  defense  budget  in 
the  united  States  goes  to  pay  for  defense  manning. 3.  Some  35 
percent  of  the  defense  manning  is  comprised  of  aircraft 
maintenance  personnel.  Therefore*  reduction  in  the  costs  of 
tixcraft  maintenance  personnel  can  greatly  impact  the  over¬ 
all  defense  manning  costs. 

The  Air  Force  is  also  concerned  with  the  recruitment  of 
sufficient  numbers  of  people  to  maintain  the  enlisted  force. 
The  Air  Force  is  currently  having  difficulty  recruiting 
enough  educated  young  people  to  maintain  present  levels  of 
manning.2 

In  order  to  reduce  costs*  there  is  much  current  emphasis 
upon  shifting  wartime  requirements  to  the  reserve  forces.2 
'  ‘-.udies  are  currently  underway  to  determine  to  what  extent 
this  can  be  done  without  adversely  affecting  the  capabi¬ 
lities  of  the  Air  Force.  Uowever*  the  reserve  units  are 
also  experiencing  recruiting  problems*  and  a  temporary  solu¬ 
tion  to  the  manning  shortage  must  be  found. 
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One  possibility  is  to  reduce  the  term  of  enlistment 
from  the  current  four  ye«r*  to  two  years.  This  would  have 
the  following  assumed  benefits! 

1.  Entice  more  young  volunteers  into  service. 

2.  Reduce  the  average  pay  scale  of  servicemen. 

i 

3.  Make  more  trained  personnel  available  to  the 
reserves . 

4.  Allow  more  rapid  utilisation  of  new  trainees. 

Some  of  the  arguments  against  a  reduction  in  enlistment 

time  include: 

1.  Increase  training  costs  since  enlisted  members 
would  have  to  be  replaced  sooner. 

2.  Increase  manning  requirements  since  experienced 
personnel  are  more  productive. 

3.  Decrease  mission  accomplishments  since  lower 
skilled  personnel  will  take  longer  to  prepare  and  repair 
aircraft. 

In  connection  with  the  problem,  it  has  recently  been 
requested  that  current  methods  of  maintenance  manpower 
forecasting  be  altered  to  allow  for  effective  tradeoffs 
among  personnel  skill  levels.4  This  forecasting  is  most 
applicable  to  developmental  weapon  systems  that  must  be 
approved  through  the  Defense  Systems  Acquisition  Review 
Council  (DSARC) , 

The  Air  Force  recognizes  that  there  are  three  specific 
requirements  which  enlisted  personnel  must  satisfy  to 
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qualify  for  skill  level  upgrading.  These  requirements  ares 
(1)  career  knowledge,  (2)  job  proficiency,  and  (3)  job 
experience . 5 

Skill  levels  are  generally  defined  as  follows: 

1.  1-level  -  entry  level,  unqualified. 

•2.  3-level  -  graduate  of  basic  technical  training 
or  initial  on-the-job  training,  usually  less  than  two  years 
experience. 

3.  5-level  -  fully  proficient  and  capable  of  un¬ 
assisted  performance,  usually  1-7  years  experience. 

4.  7-level  -  fully  proficient  and  capable  of 
supervising  others,  usually  5-15  years  experience. 

5.  9-leve.l  -  supervisor  or  management  level  skills 
and  knowledge,  usually  10  years  experience  or  more. 

Requirements  for  skill  level  advancements  come  from 
Air  Force  Regulations  (AFR  26-11,  AFR  50-23,  AFR  39-23, 

AFR  39-1,  and  AFR  35-1).  See  Figure  1  for  the  skill  level 
advancement  diagram  reproduced  from  AFR  50-23. 

At  present,  maintenance  manpower  authorizations  for 
current  and  developmental  aircraft  weapon  systems  are 
based  upon  an  "average"  maintenance  skill  (5-level) .  Thus 
the  research  question  is,  "what  effect  upon  mission  accom¬ 
plishment  results  from  a  reduction  of  aircraft  maintenance 
personnel  skill  levels?"  In  planning  for  manpower  skill 
level  contingencies,  management  would  like  to  know  the 
impact  upon  mission  accomplishment  of  the  average 
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maintenance  person  possessing  a  3-level  proficiency. 

• 

At  present,  no  method  exists  within  the  military  to 
assess  the  impact  of  manpower  skill  level  or  proficiency 
changes.  The  primary  purpose  of  this  project  will  be  to 
establish  such  a  methodology.  If  the  methodology  estab¬ 
lished  by  this  project  proves  valuable  to  the  Air  Force 
within  the  current  framework,  it  can  then  be  generalized 
to  other  services  and  industry. 

Related  Studies 

One  of  the  problems  pointed  out  by  the  Comptroller 
General  of  the  United  States  in  a  report  to  the  Senate 
Committee  on  Appropriations  is  a  weakness  in  the  manpower 
requirements  system. 6  This  report  points  out  that  the 
military  services  operate  nearly  25,000  aircraft  with  an 
annual  maintenance  cost  of  over  6  billion  dollars.  Mili¬ 
tary  maintenance  manpower  is  the  largest  recurring  part  of 
this  cost.  Sixty  percent  of  defense  spending  is  for  man¬ 
power  . 

The  military  services  are  continually  developing  and 
adjusting  manpower  requirements.  Each  major  command  of 
the  Air  Force  is  charged  with  determining  its  aircraft  main¬ 
tenance  personnel  requirements.  Most  of  these  commands  now 
use  a  highly  sophisticated,  computer-based  system  that  sim¬ 
ulates  manpower  requirements  based  on  selected  input  cri¬ 
teria.  This  simulation  system  uses  a  preplanned  framework 
or  format  called  the  Logistics  Composite  Model  (LCOM) . 
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This  framework  or  language  is  then  used  aa  the  basis  around 
'  which  a  simulation  model  for  a  given  aircraft  organisation 

\ls  designed.  The  LCOM  technique  is  used  to  simulate  the 

> 

•  \ 

interaction  of  the  expected  maintenance  environment  and  re¬ 
quired  aircraft  operations  to  determine  the  number  of  air- 
craf maintenance  manpower  needed,  and  the  number  of  spare 
parts  \nd  support  equipment  required  to  sustain  war  under 


some  expected  scenario.  The  LCOM  system  requires  a 
thorough  understanding  of  computer  simulation  and  statis¬ 
tical  techniques,  as  well  as  operational  maintenance  and 
manpower  knowledge.  We  will  discuss  LCOM  in  more  detail  in 


a  separate  section  later. 

In  an  August  1979  technology  report,  Gordan  Eckstrand 
emphasizes  the  increasing  concern  that  the  weapon  systems 
procured  by  the  Air  Force  be  designed  within  manpower  num¬ 
bers  and  skill  level  restrictions . 7  Air  Force  regulations 
now  require  the  use  of  LCOM  during  weapon  system  develop¬ 
ment.  However,  Mr.  Eckstrand  points  out,  as  the  use  of 
LCOM  becomes  more  prevalent,  the  model  use  needs  to  be 
simplified  and  results  continually  validated.  He  further 
discusses  the  manpower  levels  versus  training  versus  system 
design  tradeoff  and  the  requirement  for  further  research 

'  f.} 

and  development  in  the  human  resources  area. 

Mr.  S.  Craig  Moore  of  the  Management  Sciences  Department, 

Rand  Corporation,  addresses  the  manpower  issue  in  terms  of 

| 

skill  level  and  pay  grade.8  He  designates  five  categories 
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to  study  direct  work  accomplished.  These  categories  are 
reproduced  as  follows: 


Pay 

Grade 

E-l ,  K-2,  E-3 
E-3,  E-4 
E-5 

E-5 ,  E-6 
E-7 


He  then  discusses  work  performed  upon  eleven  types  of 
equipment  in  terms  of  who  (which  category)  might  perform 
each  portion  of  the  work  (troubleshoot,  repair,  verify)  and 
the  time  required  for  each  portion.  The  eleven  types  of 
equipment  addressed  in  this  preliminary  report  are: 

Turbine  generators  Low  pressure  compressors 

Gasoline  generators  Turbine  compressors 

Motor  generators  Cabin  leakage  testers 

Portable  lights  Engine  hydraulic  stands 

Heaters  Motor  hydraulic  stands 

High  pressure  compressors 

Mr.  Moore  discusses  the  average  frequency  with  which 
each  task  is  required  during  peacetime  and  wartime  and  uses 
what  he  calls  a  task  flow  (a  consecutive  series  of  required 
maintenance  jobs)  method  to  illustrate  the  expected  time 
versus  level  -for  each  task.  For  each  of  the  eleven  types 
of  equipment  he  develops  an  expected  time  to  repair, 
troubleshoot  (analyse) ,  and  verify  based  upon  the  manpower 


category  utilized.  For  example,  he  uses  a  “■ ,GO’-CO““OQ“ 
portion  of  a  job  to  represent  a  task  that  is  troubleshot  by 
a  skill  level  7  Staff  or  Technical  Sergeant,  repaired  by  a 
skill  level  5  Sergeant  or  Airman  First  Class,  and  verified 
by  the  skill  level  7.  Thus,  he  illustrates  the  expected 
job/task  completion  time  for  each  of  the  eleven  types  of 
equipment  under  any  mix  of  maintenance  categories  selected. 

Captains  Bruce  French  and  Robert  Steele,  in  a  thesis 
presented  to  the  School  of  Systems  and  Logistics:  of  the>Air 
Force  Institute  of  Technology,  address  the  productivity/ 
capability  6f  maintenance  organizations  as  a  function  of 
authorized  skill  level  andoauthorized  number  of  personnel 
versus  actual  skill  levels  and  numbers  of  people  assigned 
to  the  Organization. 9  For  example,  they  used  an  organiza¬ 
tion  authorized  60  personnel  but  assigned  58  as  follows: 


Manpower 

Grid 

Authorized 

Assigned 

SL7 

■  10 

7 

Skill 

Levels 

SL5 

20 

16  • 

sl3 

30 

35 

■  • 

Total 

60 

58 

Through 

the  use  of 

this:  manpower  grid 

they  illustrate 

that  both  the  total  number  of  assigned  maintenance  per¬ 
sonnel  and  skill  levels  of  the  individuals'  involved  con¬ 
tribute  to  the  overall  productivity  of  the  organization. 
In  this  particular  example  both  the  total  number  of 
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personnel,  which  are  then  portioned  into  the  several  skill 

• 

level-grade  classifications  through  another  computer  program 
giving  all  work  centers  the  same  ratio  of  skill  levels. 

They  stress  that  all  work  centers  do  not  require  the  same 
ratio  of  skill  levels  and  that  the  relative  productivity  of 
3-level  versus  5-level  personnel  has  not  been  established. 

Although  LOOM  can  currently  be  used  to  forecast  the 
effect  of  total  manpower  differences  in  any  work  center 
upon  mission  accomplishment,  it  has  not  been  used  to  address 
the  skill  level  portion  of  the  problem. 

The  objective  of  the  thesis  was  to  develop  relative 
productivity  factors  for  3,  5  and  7  skill  levels  appertains 
to  F-4E  aircraft  maintenance  organizations.  These  relative 
productivity  factors  ware  intended  to  provide  a  meam  to 
analyse  the  productive  capability  of  a  maintenance  organi¬ 
zation.  They  considered  three  methods  to  determine  the 
relative  productivity  factors i 

1.  Direct  work  measurement  at  the  work  locations. 

2.  Opinion  survey  of  knowledgeable  people. 

3.  Statistical  analysis  of  available  data. 

Due  to  the  scope  of  the  study  and  expense  involved,  they 
selected  statistical  analysis  of  available  data. 

They  attempted  to  use  the  following  regression  model 
to  establish  the  relative  productivities  of  each  skill 
levels 

p  ■  a  +  p3X3  +  05X5  +  07X7 


10 

vh-c*re 

P  *  estimated  productivity  of  tha  organisation 
Xi  *  the  number  of  people  in  skill  level  i 
Si  ■  the  relative  productivity  of  skill  level  i 
a  ■  a  constant 

although  unable  to  develop  the  relative  productivity 
factors,  they  did  bring  many  other  considerations  to  light. 
Base  differences,  weather  conditions,  extreme  data  inaccura¬ 
cies  and  other  factors  greatly  complicate  this  method  of 
productivity  analysis. 

in  1972,  under  a  contract  with  the  Air  Force  Human 
Resources  Laboratory,  McDonnell  Douglas  Astronautics  and 
McDonnell  Aircraft  Company  performed  a  study  to  determine 
the  relationship  between  subsystem  design  characteristics 
training  costs,  training  difficulties,  and  job  performance . 10 
They  used  stepwise  regression  and  factor  analysis  techniques 
to  derive  equations  to  predict  performance  time,  technical 
order  reading  time,  number  of  errors,  and  training  equipment 
costs. 

The  purpose  of  the  current  research  effort  is  to 
develop  a  means  to  assess  the  relative  productivity  of 
maintenance  personnel  possessing  different  skill  levels. 

From  the  studies  discussed  it  is  clear  that  data  relating 
to  maintenance  task  times  suffers  from  extreme  inaccuracies. 
It  is  also  clear  that  the  study  time  and  expense  of  actual 
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work  measurement  of  the  numerous  tasks,  and  conditions  under 
which  they  must  be  performed,  would  be  prohibitive.  Actual 
test,  especially  under  simulated  war  conditions  would  be  * 

impossible.  The  methodology  utilised  in  this  research  seeks 
to  overcome  the  shortcoming  of  previous  works  while 
recognizing  the  need  for  a  cost  effective  and  versatile 
model.  LCOM  is  the  primary  tool  used  in  this  research.  An 
understanding  of  this  model  is  necessary  to  appreciate  this 
research  effort. 

The  Logistics  Composite  Model 

As  noted,  the  maintenance  manpower  resources  required 
to  support  a  complex  aircraft  weapon  system  represents  a 
large  portion  of  the  total  resources  of  Air  Force  opera¬ 
tional  commands.  Due  to  escalating  personnel  costs  and 
congressional  reductions  in  overall  armed  forces  manpower 
levels,  an  accurate  determination  of  required  maintenance 
manpower  is  essential. 

Maintenance  manpower  requirements  have  historically  been 
based  upon  peacetime  reports  of  maintenance  manhours  per 
flying  hour.  For  new  systems,  contractor  estimates  were 
used  for  initial  manning.  Differing  flying  rates,  mobility 
requirements,  spare  parts  levels,  and  the  impact  of  number 
of  aircraft,  among  other  problems,  led  to  the  search  for  a 
better  technique  to  estimate  manning.  After  several  methods 
were  considered,  computer  simulation  was  selected  because  of 
its  systematic  in-depth  analysis  of  the  maintenance  opera¬ 
tion  and  flexibility  in  terms  of  "what  if"  questions. 
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Due  to  the  need  to  represent  an  entire  flying  operation 
including  complex  interrelationships  that  exist  between 
support  resources  (personnel ,  equipment ,  spare  parts  and 
facilities)  a  highly  versatile  model  was  developed,  the 
Logistics  Composite  Model  (LOOM).  See  Keller's  Student 
Training  Text  for  an  in-depth  discussion.11 

LOOM  was  developed  in  the  mid-1960s  through  a  joint 
effort  between  the  Air  Force  Logistics  Command  and  the  Rand 
Corporation.  It  is  a  Monte  Carlo  simulation  model  written 
in  SIMSCRIPT  II. 5.  LCOM  simulates  the  interactions  of  air¬ 
craft  operations  and  support  functions  at  an  Air  Force  base. 
By  replicating  the  logistics  process,  LCOM  addresses  the 
utilization  of  support  resources  (people,  parts,  facilities 
and  equipment)  and  the  impact  of  their  interactions  and 
shortages  upon  the  capabilities  of  the  flying  unit. 

LCOM  consists  of  a  preprocessor  program,  a  simulation 
program,  and  a  series  of  postprocessor  programs.  Figure  2 , 
reproduced  from  Keller,  illustrates  how  these  programs 
interrelate. 

The  preprocessor,  or  Input  Program,  reformats  and  edits 
input  data  to  make  it  useable  by  the  Simulation  Program. 

This  data  describes  the  environment  to  be  simulated  and  pre¬ 
scribes  the  initial  values  for  required  variables.  The  data 
also  describes  mission  requirements  (takeoff  time,  number  of 
aircraft  required,  sortie  lengths,  etc.) 


The  Simulation  Program  is  controlled  by  tha  output  of 
tha  praprooasaor  and  simulates  tha  flying  of  aircraft  and 
tha  accomplishment  of  servicing  and  maintenance  tasks. 

These  tasks  include  refueling#  weapons  loading#  repair  on 
the  aircraft#  in  flight  line  shops#  etc.  This  program 
also  handles  the  utilisation  and  interaction  of  resources# 
queuing  problems#  and  statistical  record  keeping.  User 
provided  input  data  determines  the  degree  of  detail  for  all 
activities  in  the  simulation.  All  activities  and  their 
interrelationships  are  identified  and  described  by  main¬ 
tenance  task  networks.  For  each  task,  the  user  supplies 
the  task  duration  distribution  and  the  types  and  quantities 
of  resources  required  as  well  as  probabilities  and  inter¬ 
relationships  with  other  tasks.  The  total  number  of 
resources  and  resource  mix  is  limited  only  by  computer 
capacity. 

During  the  simulation#  available  aircraft  are  processed 
through  presortie  activities  toward  scheduled  missions  and 
returning  aircraft  are  processed  through  postsortie 
activities.  See  Figure  3  for  the  outline  of  the  sequence 
of  events.  From  the  user  supplied  mission  schedule  at  the 
user  established  lead  time,  the  model  draws  aircraft  from 
the  availability  pool  and  processes  the  appropriate  number 
of  aircraft  through  the  presortie  tasks.  If  presortie  tasks 
are  completed  in  time  to  meet  the  schedule#  the  mission  is 
flown  and  postflight  or  through  flight  processing  occurs. 
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The  program  checks  for  failures  in  aircraft  subsystems 

* 

(which  fail  according  to  user  specified  parameters)  and 
after  all  processing  and  repairs  are  completed,  the  aircraft 
is  returned  to  the  available  pool  to  await  assignment  to 
another  mission.  See  Figures  4  and  5,  respectively,  for 
examples  of  the  servicing  and  repair  networks. 

The  output  of  the  Simulation  Program  is  the  Performance 
Summary  Report  (PSR)  and  is  produced  at  user  specified 
intervals  during  the  simulation  period  which  is  also  user 
specified.  The  PSR  summarizes  statistics  in  six  functional 
areas: 

1.  Operations 

2.  Aircraft 

3.  Personnel 

4 .  Shop  Repair 

5.  Supply 

6 .  Equipment 

Other  status  information  is  available  upon  user  request. 

See  Figure  6  for  an  example  of  a  PSR. 

The  postprocess  programs  provide  the  user  with  four 
additional  (optional)  capabilities: 

1.  Postprocess  Summary  Statistics  -  PSR  information 
in  graphical  form. 

2.  Postprocessor  Display  -  Graphical  displays  of 


selected  aircraft. 


Figure  4.  Example  Main  Network 


Figure  5.  Example  Subsystem  Failure  Network 
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3.  Manpower  Matrix  -  Summary  data,  by  shift,  for 

% 

personnel  utilization. 

4.  Postprocessor  Parts  Failure  -  Displays  statis¬ 
tics  relating  to  parts  failure. 

See  Figure  7  for  an  example  of  the  manpower  matrix  output. 

The  mission  requirements  for  this  study  relate  directly 
co  the  maximization  of  sorties  produced  per  unit  time,  lu 
order  to  compare  5- level  and  3- level  mission  accomplish¬ 
ments,  the  same  operations  schedule  is  utilized  for  every 
simulation  effort.  This  operation  schedule  calls  for  four 
aircraft  maximum  (two  aircraft  minimum)  to  takeoff  every 
hour.  Only  a  24  UE  (unit  equipage  -  24  airplanes  available) 
organization  was  considered.  This  number  of  mission 
requests  far  exceed  the  capability  of  the  simulated  organi¬ 
zation  and  results  in  a  maximation  effort. 

Data  Required  and  Collection  Method 

The  data  required  for  this  project  included: 

1.  A  listing  of  all  maintenance  tasks  related  to 
the  F-4E  aircraft. 

2.  Failure  rate  information  for  each  aircraft 
system,  subsystem,  or  part. 

3.  The  repair  technique  for  each  maintenance  dis¬ 
crepancy,  skill  level  requirements  and  associated  repair 
times,  probabilities  of  rework  and  associated  safety  infor¬ 
mation  . 
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Figure  7 .  Example  of  a  Work  Center  Manpower  Matrix  (continued) 
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A  list  of  all  maintenance  tasks  can  quickly  be  derived 
from  the  work  unit  code  manual  for  the  selected  aircraft. 

For  this  study  we  utilize  T.O.  1F-4E-06,  Technical  Manual 
Aircraft  Maintenance  Work  Unit  Code  Manual  USAF  Series  F-4E 
Aircraft^  dated  1  June  1978,  changed  1  August  1979.^ 

The  work  unit  code  consists  of  five  or  less  numeric  and 
alphabetic  characters  and  is  used  to  identify  the  system, 
subsystem,  and  component  requiring  maintenance. 

All  maintenance  performed  upon  United  States  Air  Force 
aircraft  is  recorded  on  Air  Force  Form  349  by  the  main¬ 
tenance  specialists  who  perform  the  work.  The  specialist 
records  the  work  unit  code  to  identify  what  part  of  the  air¬ 
craft  was  serviced,  a  code  that  identifies  what  type  of 
*intenance  was  performed,  the  number  of  maintenance  men 
required  to  perform  the  work,  the  Air  Force  Specialty 
’ode(s)  of  the  specialists,  and  the  elapsed  time  of  the 
jrk,  as  well  as  other  information.  This  information  is 
then  entered  into  the  Air  Force  Maintenance  Data  Collection 
(MbvJ)  system  along  with  aircraft  flying  time,  numbe.r  of 
soities  (flights),  station  where  maintenance  is  performed, 
home  station  of  aircraft,  and  aircraft  identification.  See 
Appendix  A  for  a  discussion  of  the  MDC  system,  reproduced 
from  Air  Force  Manual  66-1. 

Failure  information  for  the  F-4E  aircraft  was  retrieved 
from  the  MDC  system  and  processed  to  recover  the  failure 
rate  (average  number  of  sorties  betwaen  maintenance  actions) 


for  each  system,  subsystem  and  component.  Due  to  biases 

♦ 

caused  by  false  or  inaccurate  reporting  in  the  MDC  inform¬ 
ation,  it  has  been  found  that  the  elapsed  time  and  crew  sise 
information  is  not  always  reliable.  However,  the  number  of 
failures,  flight  time  and  other  information  has  been  found 
to  be  accurate.  Therefore,  this  research  utilised  the  MDC 
system  to  collect  information  pertaining  to  the  failure 
rates  of  F-4E  subsystems  and  parts.  For  each  system  actual 
number  of  failures  during  a  time  period  are  divided  by  the 
total  of  sorties  flown  during  the  period.  This  mean  value 
is  then  used  in  an  exponential  distribution  to  determine 
simulation  failure  sequences.  Lieutenant  Colonel  Donald 
Tetmeyer  explains  the  rationale  in  one  of  his  publications.14 

There  are  various  techniques  that  could  be  utilized  to 
estimate  the  time  required  to  perform  maintenance  upon  air¬ 
craft.  Some  of  these  techniques  are: 

1.  Direct  work' measurement 

2.  Work  sampling 

3.  Analysis  of  Air  Force  MDC  data 

4.  Opinion  survey  of  maintenance  experts 

The  basic  method  used  in  this  research  to  collect  main¬ 
tenance  data  has  been  developed  over  the  past  15  years 
through  extensive  efforts  by  several  manpower  specialists. 
Due  to  errors  and  false  information  found  in  the  MDC  system, 
an  interview  technique,  called  an  operational  audit,  was 
used  to  determine  the  mean  task  times  for  each  maintenance 
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task  associated  with  an  aircraft  weapon  system  under  study* 

• 

The  times  ere  determined  by  discussion  with  highly 
skilled  maintenance  supervisors  and  confirmed  by  discussion 
with  maintenance  personnel  who  actually  do  the  work.  The 
consensus  average  task  time  for  every  maintenance  task*  re¬ 
quired  crew  size*  and  necessary  support  equipment  are  thus 
determined.  This  method  normally  requires  from  2  to  10 
hours  per  work  center  (there  are  15  to  30  work  centers  for 
each  aircraft  maintenance  system) ,  depending  upon  the  size 
of  the  work  center,  skill  of  the  interviewer,  and  under¬ 
standing  of  the  maintenance  personnel.  For  each  task,  the 
number  of  Air  Force  maintenance  personnel  interviewed 
depends  upon  the  similarity  (range)  of  the  estimates  re¬ 
ceived.  Little  variance  has  been  found  between  independent 
estimates  for  task  timer  received  from  different  maintenance 
specialists.  Whenever  differences  larger  than  .3  hours  are 
detected  the  specialists  involved  are  asked  to  convene  and 
produce  a  group  consenses  as  to  the  "correct"  task  times. 
This  seldom  happens. 

In  an  effort  to  validate  this  methodology  the  Tactical 
Air  Command  (TAC)  used  time  study  techniques  (performed  by 
the  Air  Force  agency  that  is  responsible  for  manpower  utili¬ 
zation  through  a  management  engineering  team  at  Seymour 
Johnson  Air  Force  Base,  North  Carolina)  to  check  many  of  the 
task  times  reported  for  the  ongoing  study  of  the  F-4E  air¬ 
craft.  Lieutenant  Colonel  Richard  Gunkel  headed  a  group 
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that  analysed  task  tiino  data  to  determine  the  type  di«- 

* 

tribution  that  boat  repreaonta  maintenance  taak  times.  As 
a  result  of  this  study  the  team  recommended  the  use  of  the 
Log  Normal  Distribution  with  the  standard  deviation  equal  to 
29  percent  of  the  mean  task  time.  The  study  also  confirmed 
that  the  interview  technique  produced  acceptable  mean  task 
times.  McDonnell  Douglas  Corporation  is  currently  conducting 
a  study  aimed  at  the  update  of  variance  estimate  for  air¬ 
craft  maintenance  tasks.  When  their  study  is  complete  we 
should  possess  better  information  about  task  time  distri¬ 
butions  and  factors  affecting  deviations  from  mean  task 
time . 

In  a  further  effort  to  validate  the  entire  simulation 
approach  the  group  ran  the  simulation  with  operational 
requirements  identical  to  those  for  the  actual  operational 
unit  at  Seymour  Johnson  Air  Force  Base.  The  results  of  the 
simulation  were  reported  to  be  within  three  percent  of  actual 
results  of  the  unit  in  terms  of  mission  accomplishment, 
manhours  expended  in  each  work  center,  and  aircraft-  turn 
time. 

It  should  be  noted  that  time  study  techniques  require  50 
to  200  times  as  long  (in  both  manhours  and  elapsed  time 
duration)  to  collect  the  same  data  that  can  be  obtained 
through  operational  audit  techniques.  Due  to  the  nonrepeti¬ 
tiveness  of  many  of  the  maintenance  tasks  involved  (some 
occur  only  once  in  several  hundred  missions)  and  the 


varying  conditions  under  which  they  might  bo  required  (rain, 
snow,  cold,  pressure  of  priority  missions,  war,  stc.)  time 
study  techniques  may  be  no  more  accurate  than  operational 
audit  techniques.  For  this  study  operational  audits  were 
conducted  at  Seymour  Johnson  Air  Force  Base  during  several 
visits  during  1979.  From  the  work  unit  code  manual  for  the 
selected  example  aircraft  each  maintenance  specialist  ident¬ 
ified  all  tasks  for  which  his/her  specialty  is  responsible. 
Each  task  was  identified  for  the  type  of  work  (remove  and 
replace,  repair  on  aircraft,  troubleshoot,  inspect  and 
verify,  etc.)  required  when  a  write  up  (discrepancy)  has 
occurred.  The  specialist  was  then  asked  to  estimate  the 
time  required  to  complete  each  task  when  the  work  is  per¬ 
formed  by  5-level  and  3-level  maintenance  personnel. 
Maintenance  crew  size,  rework  probabilities,  safety  and 
other  related  information  were  requested  from  each  specialist. 
See  Appendix  B  for  an  example  of  the  operational  audit 
technique.  See  Appendix  C  for  an  extract  from  the  list  of 
job  titles,  5-level  maintenance  repair  times,  and  3-level 
maintenance  repair  time. 

LCQM  Constraining 

When  the  LCOM  simulation  is  debugged  and  the  unconstrained 
results  analyzed  the  number  of  maintenance  personnel  in  each 
work  center  is  limited  and  the  simulation  rerun.  This  ini¬ 
tial  constraining  is  based  upon  experience  as  well  as  the 
numbers  of  personnel  called  for  in  the  unconstrained 


simulation.  Personnel  are  added  or  dropped  from  the  various 
work  centers  through  an  iterative  process  until  the  re¬ 
duction  of  one  specialist  from  any  work  center  causes  the 
simulation  results  to  be  less  than  that  called  for  in  the 
planned  scenario.  Usually  this  is  95  percent  of  the  uncon¬ 
strained  accomplishments  in  terms  of  sortie  rate. 

Although  it  is  possible  for  different  manning  levels  to 
result  in  the  same  output  in  practice  this  rarely  occurs. 

In  any  event,  the  LCOM  simulation  is  analysed  until  the  man¬ 
ning  that  results  is  believed  to  be  the  minimum  that  will 
achieve  the  desired  sortie  rate. 

Safety,  pilot  morale  and  maintenance  concepts  also 
relate  to  the  current  research.  Each  of  these  problems  was 
considered  throughout  the  interview  and  research  processes. 
Safety  Problems 

Each  of  the  maintenance  specialists  was  asked  about  safety 
problems  that  might  occur  if  a  greater  percentage  of  main¬ 
tenance  personnel  possessed  only  a  skill  level  3.  Also, 
quality  control  personnel  were  interviewed  in  an  effort  to 
determine  safety  implications  of  increased  3-level  utili¬ 
zation.  All  persons  interviewed  expressed  the  opinion  that, 
due  to  required  adherance  to  technical  orders  and  inspection 
by  higher  skill  level  maintenance  supervisors,  safety 
(ground  or  flying)  would  not  constitute  a  problem.  A  review 
of  quality  control  records  did  not  establish  a  basis  for 
believing  3-level  maintenance  is  inherently  less  safe  than 
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5-level  performance'.  However,  this  area  may  require  exten- 
sive  additional  research  prior  to  forming  firm  conclusions 
about  safety  implications. 

Pilot  Morale  Problems 

In  an  attempt  to  assess  a  possible  impact  oi  a  main¬ 
tenance  skill  level  decrease  upon  pilot  morale,  the  author 
designed  and  distributed  a  questionaire  to  a  sample  of  Air 
Force  pilots  at  Wright-Patterson  Air  Force  Base,  Ohio.  See 
Appendix  D  for  a  copy  of  the  survey  and  some  initial 
responses. 

The  first  four  questions  were  intended  to  determine  if 
there  is  a  pilot  morale  implication  and  last  two  questions 
were  intended  to  elicit  additional  information  about  pilot 
reactions  to  maintenance  skill  level  changes.  Due  to  the 
small  sample  size  and  the  subjectivity  of  the  responses,  it 
is  not  possible  to  draw  firm  conclusions  about  maintenance 
skill  level  reduction  effect  upon  pilot  morale.  However, 
one  might  note  the  alternatives!  suggested  by  concerned 
pilots.  A  more  in-depth  survey  of  aircraft  crew  members  and 
maintenance  personnel  is  suggested  prior  to  implementation 
of  any  planned  skill  level  reduction. 

Production  Oriented  Maintenance  Organization 

Production  Oriented  Maintenance  Organization  (POMO) 
refers  to  a  maintenance  organization  method  that  seeks  to 
gain  greater  overall  productivity  by  utilizing  available 
maintenance  personnel  to  assist  in  tasks  that  do  not  fall 


within  their  specialities.  POMO  has  been  implemented  and 
is  being  evaluated  at  many  Tactical  Air  Command  bases. 
Although  POMO  was  not  considered  during  this  study ,  LOOM 
now  has  the  capability,  through  the  use  of  resource  sub¬ 
stitutability  to  incorporate  POMO  into  future  studies.  See 
Keller  for  an  in-depth  explanation  of  POMO.16 
Research  Objectives 

The  objectives  of  the  current  research  effort  aret 

1.  Provide  a  method  to  account  for  various  skill 
levels  in  maintenance  manpower  forecasting  and  mission  capa¬ 
bility  assessment. 

2.  Illustrate  the  use  of  digital  simulation  to 
provide  a  means  to  analyse  the  effects  of  skill  level 
changes. 

3.  Demonstrate  the  use  of  computer  simulation  to 
verify  sampling  techniques, 

4.  Demonstrate  the  use  of  interview  techniques  to 
establish  task  times  for  different  skill  levels  within  a 
complex  aircraft  maintenance  organization. 


CHAPTER  II 


RESEARCH  METHODOLOGY 
Research  Description 

The  objective  of  this  research  is  to  develop  a  method 
whereby  an  analyst  can  forecast  the  effects  of  varying  the 
skill  levels  of  personnel  within  a  military  aircraft  main¬ 
tenance  organization.  To  accomplish  this  objective  the 
author  has  adapted  a  large  scale  computer  simulation  model 
of  a  military  aircraft  maintenance  organization.  The  inputs 
to  this  computer  simulation  model  are  varied  to  test 
the  effect  of  various  maintenance  task  times  that  relate  to 
the  possible  skill  levels  of  the  maintenance  personnel  that 
make  up  the  organization.  These  task  times  are  developed 
through  an  interview  technique  with  maintenance  specialists. 
Task  times  for  each  task  and  each  skill  level  maintenance 
specialist  are  collected  for  the  F-4E  aircraft  system.  The 
computer  simulation  model  is  then  used  to  compare  the  results 
of  several  possible  scenarios  of  differing  average  skill 
level  within  the  maintenance  organization. 

Various  sampling  techniques  are  used  to  determine  the 
least  amount  of  interview  time  and  computer  model  manipula¬ 
tion  that  will  ‘provide  the  same  simulation  results  as  the 
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complete  interview  encompassing  all  maintenance  tasks  in¬ 
volved  with  the  subject  aircraft.  The  purpose  of  the  sam¬ 
pling  is  to  reduce  the  cost  of  the  interview  process  (called 
the  "operational  audit") . 

The  costa  associated  with  a  complete  operational  audit 
relate  directly  to  manhours  required  and  elapsed  time.  A 
single  interview  will  discuss  task  times  for  up  to  100 
different  jobs.  Each  job  may  entail  10  minutes  of  dis¬ 
cussion.  Usually  2  or  3  specialists  are  interviewed  for 
each  work  center.  Thus,  we  are  talking  about  some  20-30 
minutes  to  develop  the  task  time  for  each  job.  For  the  F-4E 
aircraft,  there  are  some  2,000  tasks  which  relates  to  about 
670  interview  hours.  The  sampling  technique  developed  in 
the  research  calls  for  about  150  tasks  to  be  sampled.  This 
relates  to  50  interview  hours.  Thus  the  sampling  technique 
results  in  considerable  time  saving  in  the  interview  task 
alone. 

Also  the  sampling  technique  results  in  simplified  com¬ 
puter  model  manipulation  and  thus  saves  additional  time. 
Through  the  techniques  developed  in  this  research  the  total 
elapsed  time  to  adapt  a  current  computer  simulation  model  to 
account  for  an  average  skill  level  change  (this  includes 
interview  time  and  computer  simulation  model  adaptation) 
can  be  cut  from  four  months  to  about  one  month. 
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In  particular,  this  study  defines  and  demonstrate* 
the  utility  of  the  "operational  audit"  technique  to  acquire 
the  estimated  task  times  for  all  the  maintenance  tasks  per¬ 
formed  by  average  (5-level)  and  low  (1,-level)  skilled 
personnel  performing  maintenance  upon  the  F-4E  aircraft. 
However,  heretofore,  the  operational  audit  interview  tech¬ 
nique  has  not  been  utilized  to  collect  data  pertaining  to 
skill  level  productivity  differences.  This  research  adapts 
the  operational  audit  technique  to  collect  data  pertaining 
to  task  times  for  5-level  and  3-level  maintenance  personnel. 

The  information  gained  in  the  operational  audit  is  then 
used  in  an  LCOM  computer  simulation  model  to  prepare  a 
series  of  computer  simulation  runs.  These  simulation 
results  will  compare  5-level  and  3-level  skilled  maintenance 
personnel  productivity.  In  Figure  8  these  5-level  and 
3-level  simulation  efforts  will  be  referred  to  as  series  A 
and  B ,  respectively.  The  effect  of  the  skill  level  reduc¬ 
tion  upon  mission  accomplishment,  maintenance  manhours  per 
flying  hour  (MMHPFH) ,  and  manning  will  be  analysed.-  A 
separate  section  will  explain  what  is  considered  as  a  signi¬ 
ficant  difference. 

Series  A  and  B  are  computer  simulation  models  of  the 
same  maintenance  organization.  Series  A  incorporates  all 
5-level  maintenance  task  times  as  determined  by  the  oper¬ 
ational  audit' technique.  Series  B  incorporates  all  3-level 
maintenance  task  times  that  are  also  determined  through  the 
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operational  audit  technique.  All  maintenance  tasks  are  in- 
eluded  in  the  operational  audits  that  develop  inputs  (main¬ 
tenance  task  times)  for  series  A  and  B.  These  tasks  times# 
as  they  differ  for  5-level  and  3-level  skilled  maintenance 
personnel,  are  the  only  difference  between  series  A  and 
series  B  computer  simulation  models. 

If  there  is  no  significant  difference  between  the  series 
A  and  series  B  result  in  terms  of  mission  accomplishment, 
manhours  expended,  and  number  of  personnel  required  we  can 
determine  that  no  adjustment  need  be  made  to  the  original 
5-level  model  to  enable  us  to  forecast  the  effect  of  using 
lesser  skilled  maintenance  personnel.  Indeed,  this  result 
would  mean  that  lesser  skilled  maintenance  personnel  are 
just  as  productive  as  the  average  skilled  personnel. 

If  there  is  a  significant  difference  between  the  series 
A  and  series  B  results  we  will  be  able  to  say  not  only  that 
a  difference  exists,  but  we  can  say  what  the  relative  pro¬ 
ductivity  difference  is  between  a  maintenance  organization 
manned  by  all  5-level  personnel  and  one  manned  by  all  3- 
level  personnel.  In  this  case  the  research  will  continue 
in  an  effort  to  determine  the  simplest  method  to  forecast 
the  magnitude  of  the  3kill  level  productivity  difference. 

Due  to  the  large  amounts  of  time  required  to  perform  a 
complete  operational  audit  we  would  like  to  test  the 
feasibility  of  incorporating  various  sampling  techniques 
into  the  operational  audit  phase  of  data  accumulation.  The 
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sampling  that  we  are  evaluating  pertains  to  the  number  or 
porcent  of  maintenance  tasks  that  we  must  include  in  our 
operational  audit  so  as  to  develop  a  task  time  difference  * 
factor  for  a  maintenance  organization  or  suborganization. 

To  be  feasible,  these  sampling  task  time  difference  fac¬ 
tor  (s) ,  when  incorporated  into  the  5-level  simulation  model 
must  result  in'  the  same  productivity  and  manning  aa  the 
3-level  model  that  was  developed  from  a  full  operational 
audit.  See  Figure  8  for  the  flow  diagram  in  the  quest  for 
the  simplest  operational  audit  sampling  techniques. 

Figure  9  represents  a  mathematical  approach  to  this 
research  design.  One  can  visualize  this  as  the  LOOM  model 
of  the  real  world.  The  vertical  columns  then  represent  the 
specific  limitations  or  manipulations  required  to  analyze 
the  various  techniques  to  simulate  the  real  world  situation. 
The  real  world  side  is  narrowed  to  the  F-4E  organization, 
it  is  further  reduced  to  the  expert  opinions  of  the  task 
times  required.  Then  the  real  world  is  narrowed  through 

averaging,  sampling  and  grouping  techniques. 

The  LOOM  simulation  of  the  real  world  is  limited  to  the 
F-4E  aircraft.  Inputs  are  obtained  through  the  operational 
audit  technique  to  compare  3-level  and  5-level  output  para¬ 
meters.  Further  comparisons  are  made  using  the  LCOM  simu¬ 
lation  and  averaging,  grouping  and  sampling  techniques. 

First  let  ua  average  the  percont  expected  time  differences 
to  complete  every  task  (including  rework' probability)  with 
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Flow  Diagram  for  Operational  Audit  Sampling  Technique. 


REAL  WORLD  - -H  LCOM 
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3-level  skill  as  opposed  to  5-level  skill.  Applying  this 
factor  to  all  maintenance  tasks  in  the  original  5-level 
baseline  simulation  we  rerun  a  series  of  simulations.  The 
results  of  this  series  (C)  are  compared  with  the  first  series 
of  3-level  skill  simulation  runs  (series  B) .  If  there  is  a 
significant  difference,  this  averaging  technique  is  not  valid 
so  we  would  proceed  with  the  analysis  of  task  times  averaged 
by  work  center. 

If,  on  the  other  hand,  series  B  and  c  are  not  signifi¬ 
cantly  different  a  portion  of  the  tasks  will  be  sampled. 

The  percent  time  differences  will  be  averaged,  and  computer 
simulation  series  D  performed.  If  series  D  and  C  are  not 
significantly  different,  one  can  conclude  that  the  effects 
of  skill  level  differences  upon  mission  capability  can  be 
estimated  through  this  sampling  technique  and  computer  simu¬ 
lation.  Only  a  sampling  (see  section  on  Sampling  Size)  of 
other  aircraft  maintenance  repair  time  differences  needs  to 
be  analyzed  to  use  the  computer  simulation  technique  to 
estimate  skill  level  effect  (indeed,  the  same  correction 
factor  may  apply  to  other  aircraft  systems  as  well,  but  will 
not  be  validated  at  this  point) . 

If  series  B  and  C  are  not  significantly  different, 
series  D  is  merely  a  confirmation  as  to  the  size  of  the  sam¬ 
ple  required  to  estimate  the  population  mean  (here  the  popu¬ 
lation  mean  is  the  mean  of  the  series  C  results) . 

If  series  B  and  C  are  significantly  different,  the  task 
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time  differences  by  work  centers  can  be  averaged  and  computer 
simulation  series  E  performed.  If  there  is  a  significant 
difference  between  series  B  and  E,  the  sampling  technique  is 
not  justified.  However,  if  no  significant  difference  is 
detected,  the  task  time  differences  by  work  center  is  a 
valid  method  to  determine  skill  level  effect.  Furthermore, 
randomly  selected  samples  from  each  work  center  can  be  used 
to  test  if  the  work  center  effect  can  be  estimated  by  a 
technique  similar  to  that  described  above.  Figure  8  gives 
a  guide  to  the  simplest  operational  audit  sampling  technique. 

Data  developed  from  the  above  research  plan  will  be 
presented  as  follows: 


TABLE 

FIG.  8 
SERIES 

SORTIES/AIR¬ 

CRAFT/DAY 

MMHPFH 

SKILL 

LEVEL 

TASK  TIME 
COMP.  METHOD 

3,  5 

A 

2.3 

37 

5 

Operational 

Audit 

4,  5 

B 

1.8 

50 

3 

Operational 

Audit 

6,  7  & 
11 

C 

1.7 

55 

3 

Averaging/ 
Simple  Random 
Sampling 

8,  9 

D 

1.7/1. 8 

54/49 

3 

Work  Center 
Grouping 

10 

E 

1.8 

51 

3 

Combined 

Grouping 

Sample  Size 

Suppose,  for  any  work  center,  we  wish  to  take  a  sample 
that  will  insure  a  95  percent  probability  that  the  error  of 


41 


the  estimate  of  the  sample  mean  ()C)  percent  time  increaso 
will  not  exceed  S  percent  of  the  mean.  For  large  sample 
sizes,  X  tends  to  be  normally  distributed  with  mean  w  and 
variance  u2/n.  Thus  for  a  95  percent  confidence  interval 
we  have 

P  l  X  -  <  y  <  X  +  -7^-  1  -  .95 

/n  /n 

Therefore,  for  an  error  of  the  estimate  to  be  .15?,  we 

1  9  60 

set  this  value  equal  to  —-—t—  and  solve  for  "n". 

/n 


This  gives 


1.9  60 
.IX 


Since  we  do  not  have  a  let  us  substitute  the  sample 
estimate  "sM  as  an  approximation.  17  AIbo,  since  we  are 
anticipating  a  small  value  of  "n" ,  we  will  use  the  "t"  dis¬ 
tribution  to  obtain  the  coefficient  for  s//n.  Now  we  can 
use  the  "s"  and  X  for  each  work  center  in  a  progressive  or 
iterative  fashion  to  keep  an  ongoing  X  and  "s*  and  add  new 
random  samples  until  the  formula 

n  *  [  M  l2 


gives  a  value  of  "n”  that  is  less  than  or  equal  to  the  cur¬ 
rent  number  of  samples  for  the  work  center  under  consider¬ 
ation.  As  a  first  effort,  25  samples  (for  all  work  centers 
that  have  more  than  25  tasks,  elsewise  a  100  percent  sample) 
were  drawn  from  each  work  center.  The  computed  mean, 
sample  size,  sample  variance,  number  of  samples  required  for 
a  95  percent  confidence  of  work  center  mean  task  time 
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within  the  range  ?  ±  ,l5f  and  the  actual  25  percent  confi¬ 
dence  range  for  the  curront  sample  are  presented  in  Table  1. 
For  reasons  that  will  be  apparent  later,  the  statiatical 
techniques  and  number  of  samples  chosen  is  sufficient  for 
the  purpose  of  the  study. 

Some  of  the  parameters  that  can  be  used  in  suoh  a  teat 
include i 

1.  The  work  hours  for  each  work  center. 

2.  The  average  preflight  preparation  times. 

3.  The  average  postflight  service  time. 

4.  The  total  number  of  sorties  accomplished. 

As  explained  in  the  previous  section,  baseline  (series 
A  or  B  as  appropriate)  results  are  compared  to  each  pro-  . 
gressive  experimental  design  step.  The  significance  can  be 
estimated  by  using  an  F-test,  The  null  hypothesis  (Ho)  in 
each  case  will  state  that  there  is  no  difference  between  the 
mean  value  of  the  parameter  under  consideration  for  the 
baseline  3-level  simulation  and  the  alternative  method  being 
compared.  In  this  way  we  can  progressively  compare* the 
baseline  3-level  output  to  the  baseline  5-level,  the  3-level 
using  averaging,  the  3  level  using  simple  random  sampling, 
and  the  3-level  using  group  techniques. 

To  calculate  the  power  of  the  F-test,  four  quantities 
must  be  known: 

n  -  the  number  of  observations  in  each  sample 

a  -  the  significance  level 
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a2  -  the  population  variance 

v  -  the  actual  means  of  the  treatment  population 
The  first  two  are  controllable  but  the  latter  two  quan¬ 
tities  are  only  estimates. 

However,  from  Lindman  we  learn  that  the  F-test  is  the 
most  powerful,  practical  test  of  the  H0  and  reasonable 
estimates  of  the  power  can  be  made. 18  The  estimate  can  then 
be  used  to  determine  how  large  an  "n"  will  be  needed  for  any 
specified  significance  level  and  power. 

For  example,  let  us  compare  the  manhours  for  a  given 
work  center  using  normal  skill  levels  and  low  skill  levels 
assuming  25  manhours  per  unit  time  as  the  difference  in  mean 
time  that  needs  to  be  detected.  First,  choose  .05  as  the 
significance  level  (a)  and  choose  .9  as  the  desired  prob¬ 
ability  of  detecting  such  a  difference  (the  power  of  the 
test) .  The  number  of  observations  (n)  per  group  can  then  be 
estimated  from  Table  A-10  in  Lindman  to  be  about  15  obser¬ 
vations  in  each  group. I9 

From  this  starting  point  one  can  make  15  simulation  runs 
for  each  of  the  two  groups  in  the  analysis  and  calculate  the 
sample  variances  to  check  the  estimate  of  variances  made 
previously.  Now  the  number  of  simulation  runs  necessary  to 
achieve  the  desired  significance  and  power  of  the  test  can 
be  recomputed. 

The  desired  power  and  siynif icance--say  .9  and  .05 
respectively--can  be  seen  as  a  tradeoff  of  variance  and 
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required  number  of  simulation  runs  for  the  hypothetical  work 
center  of  our  example  (see  Figure  10) . 

Also  one  might  note  that  the  confidence  limits  for  the 
actual  mean  values  for  each  work  center  can  be  calculated 
from  the  equation 

P  1 *  '/s=r  *  “ '  *  .1=1 1  “ 1  *  “ 

where 

X  =  sample  mean 

s  2  »  sample  variance 

n  =  number  of  observations  in  sample 

b  =  number  of  standard  deviations  associated  with 

This  calculation  will  be  helpful  to  determine  the  magni¬ 
tude  ^f  the  effect  of  skill  level  changes  within  each  work 
20 


center . 


CHAPTER  III 


ANALYSIS  AND  RESULTS 
Task  Time  Comparisons 

There  are  over  2000  total  tasks  and  28  different  work 
centers  (career  designations  or  specialities  which  were 
chosen  for  this  study)  for  the  F-4E  aircraft.  For  each  of 
these  tasks,  elapsed  time  estimates  were  established  through 
the  operational  audit  technique  for  5-level  and  3-level 
maintenance  person:  .1.  Appendix  C  contains  the  times  for  all 
tasks  for  each  skill  level.  Table  2  gives  a  listing  of  all 
work  centers ,  the  number  of  separate  tasks  for  each  work 
center,  and  the  average  ratio  of  3-level  divided 
by  5- level  task  time.  The  variances  for  sampled  task  times 
are  also  reproduced  in  Table  2. 

Simulation  Analysis 

The  output  of  the  5-level  maintenance  simulation  runs 
appears  in  Table  3.  This  is  series  A  in  the  experimental 
design.  The  output  includes  the  average  sorties/aircraft/ 
day,  the  total  maintenance  manhours  per  flying  hour,  the 
maintenance  manhours  per  flying  hour  for  each  work  center, 
the  average  presortie  and  postsortie  processing  times. 

The  mean  figure  for  each  category  is  calculated  as  well  as 
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the  variance  and  number  of  "runs"  necessary  to  bo  95  parcant 
confident  that  the  actual  mean  is  within  10  porcont  of  tha 
simulation  mean.  The  number  of  runs  is  calculated  by  tha 
statistical  technique  previously  described  on  page  41.21 

These  data  come  from  140  days  of  simulation.  The  first 
90  days  were  used  to  calculate  the  variance  and  estimate  the 
number  of  data  points  required  to  meet  the  confidence  limits 
stated  above.  An  autocorrelation  program  was  also  utilized 
to  determine  how  many  days  need  be  simulated  to  constitute 
each  independent  data  point.  The  autocorrelation  effort 
demonstrated  that  any  one  simulation  day  is  not  statisti¬ 
cally  correlated  with  any  preceding  or  following  day.  Due 
to  the  extremely  large  number  of  occurrences  each  simulation 
day,  these  results  are  intuitive. 

The  output  of  the  3-level  simulation  runs  are  presented 
in  Table  4.  This  is  experimental  design  series  B.  The 
same  information  is  provided  as  for  the  5-level  maintenance 
simulation  evaluation.  For  this  simulation  effort  every 
task  time  has  been  evaluated  and  changed  as  necessary  to 
account  for  the  additional  time  required  for  low  skilled 
(3-level)  maintenance  personnel. 

Clearly  there  is  a  large  difference  in  mission  capa¬ 
bility  when  low  skilled  maintenance  is  utilized.  The  most 
significant  numbers  to  compare  at  this  point  relate  to 
average  sorties/aircraf  t/day  and  MMIIPF  (  (76  percent  as  many 
sorties  produced  and  134  percent  as  many  manhours  used) . 
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See  Table  5  for  the  comparison  of  eaoh  work  center.  Note 
that  these  are  two  extreme  positions.  The  5-level  baseline 
situation  stems  from  the  assumption  that  all  assigned  main¬ 
tenance  personnel  perform  at  the  5- level  rate.  The  3-level 
baseline  situation  comes  from  the  assumption  that  all 
assigned  maintenance  personnel  perform  at  the  3-level  speed. 

i 

Having  demonstrated  a  significant  effect  from  utilising 
3-level  maintenance!  it  is  now  necessary  to  find  the  sim¬ 
plest  method  to  forecast  these  results  without  the  need  to 
perform  a  full  operational  audit  for  each  aircraft  weapon 
system.  This  leads  to  the  experimental  design  series  C. 

By  weighting  average  sample  work  center  task  time  per¬ 
cent  increase  by  the  number  of  tasks  within  each  work 
center,  the  overall  average  percent  of  task  time  increase 
when  maintenance  is  performed  by  3-level  versus  5-level 
personnel  is  149.4  percent.  This  percentage  is  developed 
as  follows.  We  sample  each  work  center  to  get  an  average 
percent  task  time  increase  for  3-level  versus  5-level 
maintenance.  Then  we  weight  each  work  center's  percent 
task  time  increase  by  the  proportion  of  total  tasks  that 
fall  within  that  work  center.  The  result  is  an  overall 
average  task  time  increase  factor  of  1.494.  Because  we  are 
anticipating  further  uses  for  our  data  a  stratified  sampling 
technique  is  used  to  collect.  Now  we  multiply  every  task 
time  in  the  original  5-level  simulation  program  by  1.494 
and  then  rerun  the  simulation.  In  LCOM  this  figure  is 


called  a  TMULT  (Task  Time  Multiplier) .  The  results  of  this 
technique  are  presented  in  Table  6.  Again  the  same  con¬ 
fidence  limits  were  used  to  determine  the  run  lengths*  We 
will  make  use  of  these  stratified  samples  again  when  we  con¬ 
sider  data  grouped  by  work  center  and  other  grouping  methods. 

Another,  and  more  precise  way  to  calculate  an  overall 
task  time  increase  factor  is  to  weight  the  average  sampled 
work  center  task  time  percent  increases  by  the  average 
maintenance  manhours  per  flying  hour  ratios  from  the  5-level 
simulation  results.  This  additional  weighting  takes  into 
account  the  number  of  times  each  particular  work  center 
performs  maintenance,  elapsed  maintenance  time,  and  crew 
size  as  well  as  the  average  task  time  increase  for  3-level 
versus  5-level  maintenance  personnel. 

The  results  of  this  method  of  averaging  is  an  overall 
task  time  increase  factor  of  1.463.  Table  6  also  displays 
the  results  of  using  TMULT  *  1.463. 

Since  both  of  the  preceding  TMULT  calculations  round 
off  to  1.5  when  using  two  place  accuracy,  Table  7  includes 
a  TMULT  factor  of  1.5  to  check  the  sensitivity  of  the  LCOM 
simulation  in  relation  to  these  different  TMULT  figures. 

From  Table  7  note  that  these  three  TMULT  value  give  nearly 
the  same  results. 

Significant  Differences 

The  term  "significant  difference"  in  the  sense  utilized 
for  this  study  depends  entirely  upon  which  question  is  to  be 
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answered.  In  terms  of  sorties/aircraf t/day  a  difference  of 

% 

10  percent  or  approximately  .2  sorties/aircraf t/day  is  con¬ 
sidered  highly  significant  and  a  difference  of  5  percent  or 
.1  sorties/aircraf t/day  is  considered  notable.  This  is  a 
consensus  from  past  LCOM  studies.  As  can  be  observed  in 
Tables  3  and  5#  the  sorties/aircraf t/day  do  not  significant¬ 
ly  differ  between  3-level  baseline  (Series  B)  and  the  three 
TMULT  efforts  (Series  C) . 

In  the  case  of  maintenance  manhours  per  flying  hour 
(MMHPFH)  management  uses  5-10  percent  as  a  significant 
difference.  As  explained  previously,  the  "n"  (number  of 
simulation  data  points)  required  to  be  within  10  percent  of 
the  true  mean  is  calculated.  The  "n"  required  to  insure 
the  power  of  the  test  to  be  at  least  .90  is  also  determined. 
In  all  cases  the  number  of  samples/simulation  days  meet  both 
requirements.  As  can  be  seen  in  Tables  4,  6  and  7,  the 
MMHPFH  for  the  3-level  baseline  (Series  B)  simulation  effort 
does  differ  from  the  three  TMULT  simulation  methods  (these 
three  methods  do  not  significantly  differ  from  each-  other) 
by  nearly  10  percent.  In  all  cases  the  TMULT  methods 
require  less  average  presortie  preparation  time  but  more 
postsortie  time.  We  shall  pursue  this  later. 

Work  Center  Task  Time  Increase  Factor 

Before  looking  for  an  explanation  to  this  "coincidence," 
the  Series  E  section  of  the  experimental  design  is  analysed. 
Whereas  the  TMULT  methods  grouped  all  tasks  irrespective  of 


work  center i  this  time  we  will  consider  each  work  center 
separately  for  the  purpose  of  the  simulation. 

Multiplying  ail  tasks  within  each  work  center  by  the 
average  task  time  increase  for  the  work  center  (as  deter* 
mined  by  the  stratified  sampling  by  work  center)  and  rerun¬ 
ning  the  simulation  effort  produces  the  results  in  Table  8. 
Remember  that  we  initially  collected  our  samples  by  work 
centers  and  calculated  the  number  of  samples  required  from 
each  work  center  to  meet  the  95  percent  confidence  restric¬ 
tion.  We  now  apply  the  work  center  related  factor  to  all 
task  within  the  baseline  5- level  simulation  to  produce  our 
estimated  3-level  output.  The  sorties/aircraft/day ,  and 
all  of  the  work  center  maintenance  manhours  per  flying  hour 
are  in  line  with  the  baseline  3-leve.l  (Series  B)  data. 
However,  the  difference  in  the  total  MMHPFH  is  significant. 
Other  Grouping  Techniques 

Now  let  us  divide  the  work  centers  into  groups  and  treat 
each  group  as  we  previously  treated  the  work  centers.  For 
example,  choosing  three  groups  by  comparing  the  average  per¬ 
cent  time  increase  for  each  work  center.  Then,  using 
natural  break  points,  we  can  divide  the  work  centers  into 
categories  according  to  the  task  time  increase  factors.  The 
difference  in  the  task  time  increase  factors  can  be  grouped 
into  small,  moderate,  and  large  difference  categories.  Each 
5-level  baseline  task  time  is  then  multiplied  by  one  of  the 
three  group  task  time  increase  factors  from  the  following: 
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Small 

Difference 

Moderate  Difference 

Large 

Difference 

326X0 

1.34 

- r - 

321Q2 

1.51 

325X0 

1.58 

328X1 

1.32 

325X1 

1.46 

328X3 

1.61 

328X4 

1.36 

404X1 

1.46 

324X3 

1.56 

329X0 

1.37 

423X0 

1.46 

431F1 

1.58 

423X5 

1.34 

423X1 

1.44 

431R1 

1.64 

431Y1 

1.31 

423X2 

1.49 

531X0 

1.62 

462G0 

1.18 

423X4 

1.50 

531X3 

1.56 

462W0 

1.30 

462X2 

1.44 

531X4 

1.38 

461X0 

1.50 

462L0 

1.47 

531X1 

1.44 

531X5 

1.50 

The  unweighted  mean  is  then  calculated  for  each  category. 

All  tasks  for  each  category,  as  utilized  in  the  5-level 
baseline  situation,  are  then  multiplied  by  the  respective 
task  time  increase  factor. 

A  simulation  was  run  utilizing  this  grouped  work  center 
technique.  As  can  be  seen  in  Table  8,  the  results  are  quite 
similar  to  those  of  the  work  center  sampling  technique. 
Again,  the  total  MMHPFH  result  is  significant. 

In  an  effort  to  determine  why  the  total  MMHPFH  for  each 
sampling  effort  was  larger  than  the  total  MMHPFH  for  the 
baseline  3-level  simulation,  this  author  discovered  that  the 
tasks  for  which  the  5-level  and  3-levei  times  are  similar 
are  done  more  often  than  the  tasks  for  which  the  5-level  and 
3-level  times  differ  greatly.  When  looked  upon  from  another 
viewpoint  this  discovery  becomes  quite  intuitive.  Tasks 
which  are  performed  more  often,  therefore  being  more  repeti¬ 
tive  or  ordinary,  lend  themselves  to  beiny  mastered  sooner 
by  the  new  3-level  maintenance  personnel.  Whereas  tasks 
which  are  less  repetitive  (often  longer,  more  involved 
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tasks)  require  more  experience  to  be  mastered.  This  is  not 
saying  that  these  particular  tasks  must  be  accomplished  more 
often  in  order  to  be  mastered,  though  that  may  sometimes  be 
the  case.  Rather,  the  5-level,  due  to  his  longevity, 
relative  experience,  and  greater  likelihood  of  having  seen 
or  performed  this  task  more  often,  has  gained  the  speed  ad¬ 
vantage  over  the  newer  3-level. 

For  example,  if  task  A  (say  refueling  an  airplane)  is 
performed  for  each  sortie  the  3-level  will  quickly  learn  to 
be  as  proficient  as  the  5-level  maintenance  person.  On  the 
other  hand,  task  B  (say  troubleshooting  an  electrical  wiring 
problem) ,  which  may  be  performed  only  one  each  1000  sorties, 
the  3-level  may  need  much  more  time,  on  the  average,  than 
the  5-level  maintenance  person. 

Let  us  now  weight  the  sampled  task  by  the  relative 
"hits"  that  occurred  in  the  5-level  simulation  effort.  That 
is  to  say,  weight  the  task  samples  by  the  relative  propor¬ 
tion  of  time  that  each  task  occurs.  The  simplest  and  quick¬ 
est  way  to  do  this  is  to  look  at  the  output  of  the  5-level 
baseline  simulation.  From  the  "hit  matrix"  we  can  see  the 
number  of  times  each  sampled  task  was  performed  in  that 
simulation  effort. 

The  average,  weighted,  task  time  increase  factor  for 
each  work  center  can  now  be  recomputed.  When  utilizing 
these  factors  (see  Table  9)  all  parameters  are  in  line  with 
the  3-level  baseline  simulation.  Once  again  we  divide  the 
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work  centers  into  groups.  This  tima,  since  there  are  no 
groups  with  a  factor  greater  than  1.6,  use  two  categories. 
Weight  the  factors  by  the  number  of  "hits"  as  described 
previously.  This  yields  1.25  as  a  TMULT  for  all  work  centers 
that  had  a  task  time  increase  multiplication  factor  less  than 
1.35  in  Table  9,  and  1.50  as  a  TMULT  for  all  work  centers 
with  a  weighting  factor  greater  than  1.35.  The  results  are 
presented  in  Table  10.  One  can  also  recompute  the  overall 
TMULT  factor  using  this  weighted  sampling  technique. 

The  results  of  rerunning  the  Series  C  simulation  effort 
with  TMULT  =  1.35  (see  Table  11),  verify  that  the  four  para¬ 
meters  all  meet  the  established  significance  criterion  (that 
is,  no  significant  difference  between  Series  C  and  Series  B) . 

Thus  each  of  the  three  methods  that  utilise  the  final 
weighting  technique  produce  the  same  results  in  terms  of 
sortie  rate  and  maintenance  manhours  per  flying  hour.  How¬ 
ever,  some  of  the  individual  work  centers  do  not  remain 
within  the  10  percent  guide  in  terms  of  MMHPFH.  Before 
analyzing  this  individual  work  center  difference,  the 
current  results  are  summarized. 

Depending  upon  what  question  one  is  seeking  to  answer 
one  can  now  select  the  sampling  technique  that  best  resolves 
the  problem.  If  one  wishes  to  know  only  the  change  in  ex¬ 
pected  sorties/aircraf t/day ,  a  simple  random  sample  of  size 
"n",  when  n  =’ [  ]2  as  defined  previously,  will  suffice 

to  determine  the  TMULT  factor,  which  can  then  be  used  to 
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resolve  the  question  to  the  desired  accuracy.  If  one  wishes 
to  know  the  effect  a  skill  level  change  has  upon  total  main¬ 
tenance  manhours  per  flying  hour  he  needs  to  weight  the 
samples  by  the  number  of  hits  from  a  current  5-level  simu¬ 
lation  run.  If  he  wishes  to  know  the  effect  upon  average 
presortie  or  postsortie  preparation  time,  the  same  method 
will  work.  However,  if  we  wish  to  know  the  effect  upon 
maintenance  manhours  per  flying  hour  per  work  center  we 
must  use  a  stratified  sampling  method  in  conjunction  with 
the  "hit  matrix"  from  the  5-level  simulation.  For  the  last 
problem  group  the  work  centers  into  two  or  more  groups  and 
then  use  a  different  multiplication  factor  for  each. 


CHAPTER  IV 


ANALYSIS  AND  RESULTS  WITH  LIMITED  MANPOWER 
The  Constraining  Process 

The  most  important  question  remains,  "what  effect  upon 
mission  accomplishment  results  from  a  reduction  of  aircraft 
maintenance  personnel  skill  levels?"  Up  to  this  time  there 
has  been  no  mention  of  a  restriction  upon  the  number  of 
personnel  in  the  maintenance  work  centers.  Indeed,  the 
assumption  has  been  unlimited  manning.  This  is,  whenever 
the  simulation  program  called  for  maintenance  personnel, 
they  were  available.  There  were  no  queuing  problems. 

Tables  12  through  17  will  present  the  constrained 
(limited  manpower)  data  in  the  following  wayi 

FIG.  8  SORTIES/AIR-  WORK  CENTER  SKILL 


TABLE 

SERIES 

CRAFT/DAY 

MMHPFH 

_  LEVEL 

12,14 

A 

2.2 

37 

210 

5 

13,14 

B 

1.8 

49 

274 

3 

15 

C 

1.8 

49 

274  r 

3 

16 

D 

1.8 

49 

274/0 

3 

17 

E 

1.8 

51 

274/0 

3 

This  flow  plan  is  the  same  as  described  in  Figure  8  and  used 
for  the  unconstrained  manpower  model. 
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Ws  will  follow  ths  tamo  proceaa  to  determine  tha  con- 
atrainad  manning  aituation  aa  wa  did  in  Chaptar  IZI  with 
tha  unlimitad  manning  aituation.  First,  we  will  limit  tha 
manning  available  in  tha  5-level  baseline  simulation  to 
establish  a  constrained  baseline.  This  is  series  AC  Than 
we  will  limit  the  manning  available  to  the  3-level  baseline 
model  which  use  100  percent  operational  audit  task  time 
data.  This  is  series  BC  From  here  we  will  proceed  with 
averaging,  sampling  and  grouping  techniques  to  determine 
the  feasibility  of  using  a  simplified  technique  to  reproduce 
the  results  of  series  B".  As  in  Chapter  III  we  will  again 
compare  sorties/aircraft/day  and  MMHPFH  but  in  addition  we 
must  include  a  comparison  of  the  manning  package  broken 
down  by  work  centers. 

This  manning  package  is  essential  since  we  must  be  pre¬ 
pared  to  analyse  the  expected  differences  in  mission  accom¬ 
plishment  as  a  result  of  skill  level  changes.  The  expected 
sortie  rate  and  manpower  deviation  for  each  specialty  are 
of  utmost  importance  to  the  decision  maker  in  planning  for 
various  contingincies. 

With  limited  manning  the  maintenance  organization  can 
not  achieve  its  maximum  sortie  rate.  It  is  common  practice 
to  use  LCOM  to  determine  tha  minimum  manning  package  that 
will  allow  achievement  of  95  percent  of  the  sortie  rate  that 
is  possible  with  unlimited  manning.  As  explained  in  the 
LCOM  manual,  the  available  manning  is  limited  in  an 
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iterative  fashion  until  the  minimum  manning,  by  work  center, 
is  determined.  That  is,  the  minimum  manning  that  will  pro¬ 
duce  the  required  results  as  defined  in  the  desired  scenario. 

In  the  case  of  an  F-4E  model  we  initially  reduce  the  man¬ 
ning  in  each  work  center  by  reference  to  the  matrix  output 
(see  page  21,  Figure  7  for  an  example  matrix)  for  the  appro¬ 
priate  work.  The  objective  is  to  assign  a  limited  number  of 
personnel  to  each  work  center  while  still  achieving  a  high 
sortie  rate.  To  achieve  this  the  LOOM  analyst  observes  how 
many  maintenance  specialists  were  used  in  the  unconstrained 
simulation  runs.  The  analyst  further  notes  how  often  parti¬ 
cular  numbers  of  specialists  were  required  for  the  subject 
work  center.  The  analyst  then  subjectively  assign  the  number 
of  specialists  to  be  available  to  that  work  center  for  the 
following  simulation  run.  While  allowing  some  maintenance 
tasks  to  be  back  ordered  (that  is,  to  wait  until  the  required 
specialist (s)  is  available)  the  overall  effect  should  not 
cause  the  loss  of  a  significant  number  of  sorties. 

The  analyst  does  the  same  type  of  analysis  for  each  work 
center  to  establish  the  initial  constrained  manning  package 
estimate.  The  simulation  model  is  then  rerun  and  the  result 
observed.  The  overall  sortie  rate  and  the  manpower  matrix 
(now  augmented  by  a  manpower  back  order  matrix)  for  each  work 
center  are  again  analyzed. 

Once  again  the  LOOM  analyst  studies  these  simulation  out¬ 
puts  and  establishes  a  new  manpower  package.  Thus  the 


manpower  package  it  progressively  changed  and  fine  tuned 
until  the  analyst  is  convinced  that  the  minimum  manning  has 
been  achieved  for  each  work  center. 

This  iterative  approach  to  manpower  constraining  often 
requires  one  or  more  man  months  to  achieve.  This  constrain¬ 
ing  effort  was  separately  performed  upon  our  5-level  and  our 
3-level  models.  If,  for  5-level ,  this  manning  package  is  210 
people  for  a  normal  LCOM  analysis  (this  is  only  the  direct 
labor  force  per  shift  for  the  work  centers  that  are  dis¬ 
played  -  see  Table  12),  can  one  now  expect  to  get  75  percent 
as  many  sorties  accomplished  in  a  given  time  period  by  using 
210  3-level  maintenance  personnel?  The  answer  is  no,  even 
assuming  no  safety  or  other  problems  to  prevent  the  3-level 
maintenance  personnel  from  performing  any  task.  Due  to  the 
additional  queuing  problems,  since  longer  task  times  will 
create  even  longer  aircraft  wait-for-service  times,  the 
actual  accomplishments  well  be  far  less  than  95  percent  of 
the  unconstrained  3-level  situation. 

Thus,  increase  the  assigned  manning  or  decrease  our 
expectations  in  terms  of  sortie  rate  achievement.  See  Table 
13  for  the  results  of  this  3-level  constraining  effort. 

One  further  area  needs  to  be  discussed.  That  is  the 
situation  of  minimum  crew  manning.  Due  to  the  numerous 
different  specialities  in  the  Air  Force  maintenance  organi¬ 
zation,  certain  work  centers  do  net  have  enough  work  to  keep 
their  personnel  busy.  These  work  centers  still  require  a 
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minimum  crew  to  be  on  duty  at  all  times  during  a  maximum 
sortie  generation  effort.  However,  the  actual  workload  in 
these  work  centers  can  be  varied  greatly  without  affecting 
the  required  manning.  The  work  centers  that  have  "minimum 
crew  size  manning"  are  indicated  in  Tables  12  and  13. 

However,  from  these  tables  it  is  clear  that  the  minimum 
manning  package  required  to  achieve  95  percent  of  the  uncon¬ 
strained  3-level  accomplishment  is  far  greater  (274  manpower) 
than  that  of  the. 5-level  baseline  situation  (210  manpower). 

It  requires  about  30  percent  additional  3-level  manning  to 
achieve  75  percent  of  the  5-level  accomplishment.  If  we  were 
to  constrain  the  5-level  manning  to  get  the  same  achievement 
as  the  maximum  3-level  capability  we  would  need  only  160  5- 
level  personnel  to  accomplish  the  same  sortie  rate  as  infi¬ 
nite  3-level  personnel  (see  Table  .14)  .  To  get  these  results 
we  constrain  the  3-level  baseline  simulation  to  the  point 
where  the  loss  of  one  more  specialist  in  any  work  center  will 
result  in  less  than  the  maximum  sortie  rate.  The  we  con¬ 
strain  the  5-level  baseline  simulation  model  until  we  get 
the  same  sortie  rate  as  the  maximum  3-level  effort. 

We  have  developed  a  method  whereby  we  can  forecast  the 
expected  effect,  in  terms  of  sortie  rate,  total  maintenance 
manhours,  and  total  manning  of  a  complete  reduction  of  the 
maintenance  force  skill  level.  Next  we  will  tackle  the 
manning  problem  in  terms  of  specialities  (work  centers) . 


constraint  that  Batches  3-lerel 


75 

We  now  wish  to  determine  whether  sampling  techniques 
can  be  utilized  to  determine  the  manning  levels  for  each 
of  the  work  centers.  We  will  utilize  the  3-level  baseline, 
the  weighted  work  center  sampling  model,  the  weighted  and 
grouped  work  center  sampling  model,  and  the  TMULT  »  1.35 
model.  These  models  are  of  interest  because  they  each  pro¬ 
duced  the  same  sortie  rate  and  total  MMHPFH. 

When  we  constrain  the  TMULT  =  1.35  model  we  get  the  man¬ 
ning  results  found  in  Table  15.  Although  the  total  MMHPFH 
and  sortie  rates  are  similar  to  the  results  of  the  3-level 
baseline  simulation,  both  the  total  manning  and  the 
individual  work  centers  show  variations.  Obviously,  the  use 
of  a  TMULT  technique  can  be  used  for  sortie  rate  and  total 
MMHPFH  determination  but  not  for  precise  manning  analysis. 

Let  us  nejxt  work  with  the  weighted  work  center  sampling 
method.  Constraining  this  model  we  get  precisely  the  same 
results  as  we  got  from  the  3-level  baseline  model  (see  Table 
16).  That  is,  we  get  the  same  manning  package,  the  same 
sortie  rate,  and  the  same  total  MMHPFH.  Clearly  then,  use 
of  this  technique  will  determine  the  effect  of  maintenance 
skill  level  changes. 

Let  us  now  redefine  our  work  centers  in  such  a  way  as  to 
minimize  the  numbers  of  categories,  and  thus  the  number  of 
samples  required  for  our  desired  accuracy,  that  will  still 
produce  the  same  sortie  rate,  total  MMHPFH,  and  manning 
package.  We  know  that  grouping  our  work  centers  into  one 
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category  will  not  work  (this  was  our  TMULT  =  1.35  effort), 
so  let  us  proceed  with  two  categories. 

One  simple  method  to  group  the  work  centers  is  to  divide 
them  into  two  categories  as  defined  on  page  61«  All  of  the 
work  centers  with  weighted  sample  average  task  time 
increases  of  less  than  1.35  are  multiplied  by  the  common 
factor  1.25.  All  those  work  centers  with  weighted  sample 
average  task  time  increases  greater  than  1.35  are  multiplied 
by  the  common  factor  1.50. 

Constraining  this  model  produces  the  results  found  in 
Table  17.  As  can  be  seen  in  Table  17,  this  technique 
produces  the  same  manning  package  and  sortie  rate  as  the 
3-level  baseline  simulation  model.  Therefore,  this  sampling 
technique  is  an  acceptable  substitute  that  will  give  the 
sortie  rate  and  manning  differences  between  5-level  and 
3-level  maintenance  manning  for  the  F-4E  aircraft. 
Qualifications  and  Limitations 

This  study  has  produced  a  method  that  can  be  utilized  to 
estimate  the  effect  of  a  skill  level  change.  The  use  of  the 
F-4E  aircraft  has  been  only  an  example.  All  work  centers 
were  not  included  in  the  tables.  Some  were  so  small  that 
minimum  manning  was  obviously  sufficient.  Phase  inspection 
was  not  included  since  it  was  assumed  that  these  tasks 
would  be  deferred  during  the  period  of  surge  effort.  Other 
unscheduled  maintenance  was  not  assumed  to  be  deferrable. 
Only  one  type  of  mission  was  utilized  in  this  study  but 


others  could  be  Incorporated  without  model  changes.  The 
shift  manning  levels  produced  in  this  study  are  not  presented 
as  the  optimal  situation  but  rather  for  comparison  of  5-level 
and  3-level  output  potential  under  the  simplified  hypothe¬ 
tical  scenario  described. 

Although  every  work  center  and  each  wo:*k  unit  code  (WUC) 
task  were  included  in  the  operational  audit,  the  task  times 
that  were  developed  are  subjective  opinions  of  maintenance 
specialists  and  supervisors.  These  times  represent  the 
hypothetical  "average  5-level"  and  "average  3-level, "  and  dw 
not  consider  the  additional  problems  of  extenuating  circum¬ 
stances.  The  standard  deviation  for  all  tasks  is  assumed  to 
be  a  constant  percent  of  the  mean  task  time.  Weather, 
climate,  enemy  activity,  spare  parts  shortage.  Production 
Oriented  Maintenance  Organization,  multiple  aircraft  types, 
morale,  deployment  location,  and  possibly  other  relevant 
factors  have  not  been  included  in  this  study. 

The  time  required  for  a  3-level  maintenance  specialist 
to  upgrade  to  a  5-level  may  change  drastically  in  wartime  due 
to  the  accelerated  rate  of  activity.  This  upgrade  time  may 
also  be  highly  work  center  related.  The  complexity 
of  the  particular  weapon  system  or  subsystem  may  greatly 
affect  the  relative  productivity  of  a  5-level  versus  a 
3-level  maintenance  specialist. 
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Summary  of  Simulation  Anulyuls 

From  the  5-level  baseline  model,  we  have  the  uncon¬ 
strained  sortie  rate  accomplishment  and  related  manning/ 
manhours.  We  also  have  the  manning  necessary  to  achieve  95 
percent  of  the  unconstrained  sortie  rate  and  the  manning 
required  to  achieve  the  same  sortie  rate  as  with  the  uncon** 
strained  baseline  3-level  model.  See  Tables  12,  13,  and  14 
respectively. 

From  the  3-level  baseline  model,  we  have  the  uncon¬ 
strained  sortie  rate  and  related  manning/manhours.  We  also 
have  the  manning  required  to  achieve  95  percent  of  the 
3-level  baseline  sortie  rate. 

For  the  TMULT  (all  maintenance  tasks  multiplied  by  a 
common  factor}  effort  that  most  closely  duplicates  the 
3-level  baseline  results,  we  have  the  unconstrained  and 
constrained  results  as  well  as  the  required  manning 
comparisons  (see  Table  15) . 

We  also  have  results  from  individual  work  center  sam¬ 
pling  and  from  grouped  work  center  sampling  efforts.  For 
each  of  these  (see  Tables  16  and  17) ,  we  have  the  same 
information  as  for  the  other  methods  above. 

The  3-level  individual  work  center  sampling,  and  grouped 
work  center  sampling  models  require  the  same  manning  in  each 
work  center.  Thus  the  sampling  technique,  whereby  the  work 
centers  are  divided  in  two  categories,  will  suffice  to 
estimate  the  effect  of  the  skill  level  difference  upon 
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manning. 

We  have  now  considered  the  situation  with  all  5-level  or 
with  all  3-level  maintenance.  But  it  is  more  likely  that  we 
shall  have  a  maintenance  situation  that  has  some  combination 
of  maintenance  skills.  With  the  techniques  that  we  have 
developed  we  now  address  this  problem.  Chapter  V  is  devoted 
to  an  analysis  of  mixed  skill  levels  and  management  policies. 


CHAPTER  V 


5-LEVEL/ 3-LEVEL  MIXTURE  ANALYSIS 

It  is  necessary  to  first  define  low  maintenance  per- ... _ 

sonnel  will  be  utilized.  If  we  have  half  5-level  and  half 
3-level  personnel  doing  the  jobs,  we  could  have  maintenance 
crews  made  up  of  all  5-level,  all  3-level,  or  a  combination 
of  each.  From  the  operational  audit  interviews  we  learn 
that,  after  initial  checkout,  generally  the  task  times  for 
crews  that  include  at  least  one  5-level  are  the  same  as  for 
crews  that  include  all  5-level  personnel.  We  must  define 
our  average  maintenance  crew  skill  level  for  the  simulation 
method  that  we  are  undertaking.  If,  for  example,  the  pro¬ 
bability  that  a  maintenance  crew  for  any  particular  task 
will  include  at  least  one  5-level  (or  above)  is  50%,  then 
the  average  performance  level  of  the  maintenance  shop  is 
halfway  between  the  5  and  3  level. 

The  probability  that  a  maintenance  crew  would  include  at 
least  one  5-level  or  above  would  be  determined  by  the  parti¬ 
cular  maintenance  mix  available  and  the  management  decisions 
that  pertain  to  manpower  useage.  If,  for  the  sake  of 
argument,  we  assume  that  one-fifth  of  the  3-level  main¬ 
tenance  personnel  are  in  need  of  training  in  any  particular 
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task,  we  must  consider  one-fifth  of  the  tasks  that  are  being 
led  by  a  5-level  or  above  will  be  performed  at  the  3-level 
rate.  With  this  information,  and  the  assumption  that  all 
maintenance  will  be  done  as  quickly  as  possible,  but 
checkout  of  3-level  personnel  will  be  performed  whenever 
possible,  we  can  now  undertake  the  task  of  determining 
mission  accomplishment  with  any  particular  skill  mix. 

Table  18  illustrates  the  expected  results  when  varying 
this  average  performance  level  through  the  use  of  the  TMULT 
functions,  from  5-level  to  approximately  75  percent  5-level 
(TMULT  *  1.1),  to  50  percent  5-level  (TMULT  ¥  1.2),  to  all 
3-level.  Any  of  the  other  techniques  for  adjusting  5-level 
task  times  could  also  be  adapted  to  reflect  proportional 
levels  of  5-level  versus  3-level  task  times. 

Let  us  now  further  pursue  the  use  of  the  simulation 
models  developed  thus  far.  For  example,  management  would 
like  to  know  the  expected  effect  of  using  75%  3-level  main¬ 
tenance  personnel  with  no  change  in  number  assigned.  Sup¬ 
pose  we  learn  from  our  operational  audit  sampling  technique 
that  the  average  3-level  task  time  increase  factor  is  1.5. 

For  illustrative  purposes  first  assume  that  all  tasks 
require  two  persons  ana  no  training  is  required.  The  pro¬ 
bability  that  two  3-level  persons  are  dispatched  for  any 
particular  task  is  then  approximately  {.75) (.75)  =  .5625 
assuming  large  population.  Thus,  on  the  average,  .5625 
of  ail  tasks  are  performed  at  the  3-level  task  time 
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rate  and  .4375  of  all  tasks  are  performed  at  the  5-level 
speed.  Therefore,  we  can  use  a  TMULT  factor  of 
(.4375) (1)  +  (.5625) (1.5)  =  1.28  to  estimate  the 
maximum  accomplishment.  However,  if  we  use  a  different 
maintenance  crew  personnel  assignment  policy  we  might 
improve  our  accomplishment.  If  we  assign  one  5-level 
specialist  to  each  crew  possible  in  this  example,  then  one- 
half  of  all  crews  will  perform  at  the  5-level  rate  since 
crew  size  is  2  and  one  fourth  of  all  specialists  are  5-level 
We  now  assume  that  crews  are  dispatched  randomly  for  each 
maintenance  task,  the  probability  that  a  crew  of  two  3- 
levels  is  dispatched  for  any  particular  task  is  one  half. 

Thus  on  the  average,  half  of  all  tasks  are  performed  at  the 
3-level  task  time  rate  and  half  ot  all  tasxs  are  performed 

at  the  5-level  speed.  Therefore,  we  can  use  a  TMULT  factor 
of  (.5)(1)  +  (.5)  (1.5)  =  1.25  to  estimate  the  maximum 
expected  accomplishment.  Tms  second  policy  improves 
sortie  accomplishment  by  approximately  five  percent 
while  decreasing  MMHPFH  by  four  percent  (see  Table  19) . 

To  take  our  example  a  step  further,  in  addition  to  crew 
skill  level  makeup,  we  can  choose  when  to  dispatch  main¬ 
tenance  crews  that  possess  each  task  rate.  If  we  were  to 
follow  the  policy  that  crews  possessing  the  5-level  speed, 
are  to  be  dispatched  whenever  available  we  can  further 
increase  sortie  rate  and  reduce  MMHPFH  during  a  surge  effort. 


From  the  matrix  output  for  each  specialty  we  can  now 
determine  the  probability  of  having  an  available  crew  pos¬ 
sessing  5-level  speed  when  a  maintenance  task  must  be  per¬ 
formed.  For  this  simplified  example  we  have  an  available 
crew  possessing  5-level  speed  approximately  70  percent  of 
the  time  when  a  job  arrives.  Thus  we  can  assign  70  percent 
of  all  tasks  to  the  faster  crews.  This  results  in  an  aver¬ 
age  TMULT  factor  of  .70(1)  +  .30(1.5)  *  1.15.  The  results 
of  this  policy  are  displayed  in  Table  19  along  with  the 
overall  percent  change  due  to  the  third  staffing  policy 
being  implemented  rather  than  the  first  (random)  policy. 

As  can  be  seen  in  Table  19,  the  use  of  policy  three 
during  a  surge  effort  produces  about  a  twelve  percent  im¬ 
proved  sortie  rate.  However,  this  policy  could  delay 
3-level  upgrade  and  may  have  a  negative  effect  for  a  large 
run  (protracted  war  scenario) . 

On  the  other  hand  if  we  were  to  dispatch  crews  with  one 
5-level  and  one  3-level  specialist  whenever  possible,  these 
3-level  specialist  would  upgrade  to  the  5-level  skill  more 
quickly  and  would  then  be  available  to  be  reassigned,  as 
5-levels  to  c\  new  crew  with  a  lesser  experienced  3-level 
specialist. 

Each  of  the  possible  policies  and  scenarios  can  be 
analyzed  with  the  models  and  techniques  developed  in  this 
study.  From  all  this  we  can  now  address  advanced  scenarios 
cf  the  following  types 


1.  We  have  210  hands-on  maintenance  personnel  per 
shift,  broken  into  specialities  in  a  particular  fashion. 

2.  We  have  24  F-4E  aircraft. 

3.  We  have  on  hand  inventory  of  some  given  amount. 
Reorder  leadtime  is  30  days. 

4.  We  will  assume  all  weather  capability  (or  all 
weather  will  be  compatible  for  our  mission) . 

5.  Currently  75%  of  all  maintenance  personnel  are 
3-level  skill. 

6.  Check  out  time  for  3-level  personnel  will  not 
affect  results. 

7.  Upgrade  to  5-level  takes  six  months. 

8.  Attrition  of  personnel  is  10  percent  per  month 
of  which  half  are  5-levels. 

9.  Replacement  personnel  arrive  at  the  same  rate 
as  attrites  but  are  all  unchecked  out  3-levels. 

10.  Management  policy  is  to  defer  phase  inspection 
during  surge  (first  30  days)  portion  of  war. 

11.  One,  and  only  one,  5-level  (or  above)  is 
assigned  to  any  maintenance  task  whenever  possible. 

Management  would  like  to  answer  the  following  questions 

1.  What  are  the  expected  sortie  rate  and  MMHPFH 
during  surge  (the  initial  30  days  of  war)? 

2.  What  are  the  expected  tradeoffs  of  sortie  rate 
and  number  of  personnel  assigned? 
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With  this  or  any  o*her  particular  scenario  and  simulation 
we  can  develop  tradeoff  charts  to  compare  different  manage¬ 
ment  staffing  policies.  Figure  11  presents  the  tradeoff  of 
number  of  maintenance  personnel  versus  sortie  rate  for  each 
of  the  three  staffing  policies  we  have  discussed  when  75  per¬ 
cent  of  the  maintenance  force  is  3-level  skill.  For  com¬ 
parison,  this  figure  also  presents  the  tradeoff  curves  when 
all  maintenance  personnel  possess  5-level  or  all  possess 
3- level. 

Figure  12  presents  the  expected  sortie  rate  when  the 
average  skill  level  of  the  organization  is  varied  while 
holding  the  number  of  personnel  constant  at  210  and  each  of 
the  three  staffing  policies  is  used. 

If  we  were  to  generalize  this  method  of  analysis  for  an¬ 
other  field  we  would  produce  the  management  aids  represented 
by  Figures  13  and  14.  In  Figure  13  we  have  number  of  per¬ 
sonnel  versus  productivity.  Each  curve  on  this  visual  aid 
represents  one  management  policy  or  skill  situation.  In 
Figure  14  we  see  the  tradeoff  between  average  skill-  level 
and  productivity.  Each  curve  would  again  represent  a  parti¬ 
cular  management  personnel  policy.  Thus  management  in  many 
areas  can  benefit  from  this  type  of  policy  comparison  aid. 

From  all  this  we  can  see  the  expected  gain  in  pro¬ 
ductivity  when  we  analyze  various  management  staffing 
policies  and  skill  situations.  Although  the  example  pre¬ 
sented  hsre  is  somewhat  simple  in  that  it  assumes  exactly 
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Figure  12 ,  Average  Skill  Level  vs  Sortie  Rate 
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Figure  13,  Number  of  Personnel  vs  Productivity 


PRODUCTIVITY 


►Mf  LEGEND 


C  :  Policy  1  Crew  members  and  crews  randomly  assigned. 

Policy  2  Crews  include  a  5-Level  to  maximum  extent 

possible  but  crews  are  randomly  assigned  to 

»'4  tasks. 

*  -**'■ 

Policy  3  Crews  include  one  5-level  whenever  possible 

and  crews  including  one  5-level  have  priority. 

[i 

►  „ 
b' 

ri 


Figure  14.  Average  Skill  Level  vs  Productivity 


95 


two  person  per  maintenance  crew,  the  concept  and  the  simu¬ 
lation  model  are  adaptable  to  many  situations. 


CHAPTER  VI 


i 


CONCLUSIONS  AND  RECOMMENDATIONS 
Research  Problem  vs  Method 

The  research  problem  was  to  determine  a  method  that  can 
be  used  to  determine  the  effect  of  a  skill  level  change  upon 
the  sortie  generation  capability  of  a  maintenance  organi¬ 
zation.  The  use  of  the  operational  audit  technique  and  MDC 
data  along  with  current  LCOM  simulation  models  of  operational 
aircraft  does  provide  such  a  method  to  analyze  the  expected 
effects.  This  method  of  skill  level  productivity  analysis 
can  readily  be  adapted  to  other  more  general  problems.  Job 
shops  could  be  analysed  in  a  similar  fashion  to  determine 
the  effects  of  personnel  turnover  or  which  employees  to 
utilize  for  overtime  work.  Bank  teller  experience  versus 
the  number  of  tellers  required  to  meet  given  specifications, 
airline  maintenance  and  customer  service  systems,  and  air 
traffic  control  work  load  are  but  a  few  of  the  related 
situations  that  come  immediately  to  mind  as  examples  for 
which  a  similar  analysis  may  be  performed.  Indeed,  this 
type  analysis  lends  itself  to  any  nonrapetitive,  large  or  high 
volume  multiple  task  situation  where  experience  or  skill 
level  affect  individual  task  times. 
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Accuracies  Achieved 

The  accuracy  of  this  method  is  dependent  upon  many 
factors.  The  skill  of  the  interviewer,  the  knowledge  and 
experience  of  the  maintenance  personnel  interviewed,  and 
the  precision  of  the  LCOM  networking  all  affect  the  results. 
The  method  of  sampling  and  the  number  of  samples  can  be 
chosen  for  any  degree  of  accuracy  desired. 

The  sample  sizes  required  for  the  desired  accuracy  for 
any  parameter  of  interest  can  quickly  be  calculated  using 
the  techniques  explained  in  the  experimental  design. 

Further  Study 

This  study  was  limited  to  the  F-4E  aircraft  and  the 
numbers/factors  calculated  can  only  be  applied  to  this 
aircraft.  However,  the  technique  is  general  and  can  apply 
to  any  aircraft  system.  It  is  also  recommended  that  a 
similar  analysis  be  performed  for  several  other  aircraft 
weapon  systems  and  the  results  be  compared  to  determine 
similarities  and/or  common  factors.  It  is  further  recom- 
mended  that  a  stratified  sampling  technique  be  utilized  in 
such  a  follow-on  study  in  order  to  verify  the  categorizing 
of  work  centers  and  resulting  multiplication  factors.  The 
following  method  is  proposed  for  a  follow-on  study; 

1.  Decide  upon  the  weapon  system  to  be  modeled. 

2.  Decide  the  accuracy  desired  in  terms  of  Type  I 


and  Type  II  error. 
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3.  For  aircraft  with  existing  LCOM  models,  divide 
work  centers  to  be  studied  into  "small  difference"  and  "large 
difference"  categories  according  to  the  Air  Force  Specialty 
Codes  as  in  Table  17. 

4.  Draw  task  times  samples  until  the  number  of 
samples  equals  or  exceeds  the  "n"  from  the  formula 

1  H«  - 

as  defined  on  page  41. 

5.  Test  the  power  of  the  test  as  described  on  page 
42. 


6.  Increase  "n"  as  necessary  to  meet  both  restric¬ 
tions  . 

7.  For  aircraft  weapon  systems  without  current  LCOM 
models  perform  the  complete  operational  audit  to  include 
both  5-level  and  3-level  task  times. 

8.  Network  the  simulation  model  as  necessary. 

9.  In  either  ca3e  run  the  model  with  5-level  data 
and  with  3-level  data  (either  individual  task  times  or 
grouped  and  weighted  factor  multiplication)  utilizing  the 
source  operations  scenario. 

10.  Run  sufficient  simulation  time  to  achieve  the 
accuracy  desired  (the  same  method  as  above  will  determine 
the  run  time  necessary) . 

11.  Analyze  the  results  and  report  findings. 


V-Y- 
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Use  of  LCOM 

The  development  of  LCOM  required  more  than  one  hundred 
man  years  of  effort  and  several  civilian  companies  as  well 
as  Air  Force  resources.  The  flexibility  and  detail  available 
in  this  programming  framework  make  it  ideal  for  the  type  of 
study  represented  by  this  research. 

LCOM  certainly  is  a  feasible  tool  which,  with  all  due 
caution,  can  be  used  for  many  varied  study  efforts  and 
research  problems.  The  use  of  the  operational  audit  tech¬ 
nique  and  MDC  data  also  deserve  serious  consideration  for 
future  use. 

Adaptation  to  Other  Current  Studies 

During  the  course  of  this  study  the  research  became 
aware  of  several  other  on-going  studies  that  might  benefit 
from  the  techniques  developed  in  this  study.  For  example, 
a  research  firm  is  studying  the  effect  upon  aircraft  turn 
time  (servicing  time)  and  sortie  generation  capabilities 
when  maintenance  personnel  must  wear  chemical  defense  equip¬ 
ment.  If  one  were  to  consider  normal  maintenance  (the 
5-level  baseline  model  utilized  in  this  study)  and  degraded 
(handicapped  by  wearing  chemical  defense  equipment)  main¬ 
tenance  capabilities,  the  task  times  determined  through 
direct  measurement  during  practice  situations  or  thorugh  an 
operational  audit  technique,  the  same  simulation  technique 
could  be  utilized  to  answer  nearly  all  "what  if"  questions. 

It  is  recommended  that  the  technique  developed  in  this  study 


be  adapted  to  on-going  studies  such  as  the  above. 

Keoearch  Accomplishments 

As  stated  earlier,  about  60  percent  of  the  total  defense 
budget  of  the  United  States  goes  to  pay  for  defense  per¬ 
sonnel.  Of  the  defense  manning  about  35  percent  relate  to 
aircraft  maintenance  personnel.  This  study  develops  an 
approach  to  assess  the  effect  of  skill  level  and  number  of 
personnel  upon  expected  mission  accomplishment.  The  use  of 
the  techniques  developed  in  this  study  can  result  in  savings 
in  terms  of  manpower  and  management  personnel  policies.  The 
sampling  technique  described  in  this  study  can  save  money 
and  time.  By  using  this  sampling  technique  the  required 
computer  time  is  reduced  to  approximately  one  quarter  of 
that  previously  required  for  similar  studies  and  three  to 
six  man  months  of  data  collection  and  analysis  time  are  saved. 
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MAINTENANCE  EXPE1UI 

9-1.  nUltFOSE.  The  purpose  of  tl»ie  rhapt*»  i»  ui 
outline  th#  Maintenance  Data  Collection  (Mt)C) 
ly^tf m  established  by-AFR  #56—  1 4  and  ATM  66  1. 
The  MDC  ta  the  primary  tourer  for  Air  Force 
reliability  and  maintainability  data;  therefore,  basic 
understanding  of  itt  objective',  uses,  and  limitation* 
la  essential  to  R  *  M  data  users. 

64.  OBJECTIVES.  The  Maintenance  unta  Collec¬ 
tion  system  was  designed  primarily  at  n  base  level 
production  credit  and  management  information  sys¬ 
tem.  The  objectives  are  to  provide  maintenance 
managers  with  information  about  the  production 
accomplished  by  the  assigned  maintenance  per¬ 
sonnel;  and  to  identify  the  equipment  on  which 
work  was  accomplished,  why  the  work  was  required, 
and  the  action  required  to  complete  the  jolt.  Tht 
MDC  system  identifies  maintenance  requirements 
rod  problem  areas  so  that  appropriate  management 
action  ran  he  taken  to  effectively  support  and  meet 
the  established  operational  requirements.  In  addi¬ 
tion,  the  MDC  system  is  designed  tn  provide  data 
to  AFLC  for  maintenance  engineering  and  logistics 
management.  Selected  data  is  also  provided  to  the 
major  commands  and  IIQ  USAF  in  accordance  with 
AFMa  66-267  and  CG-271. 

64.  SCOPF.  Th-  MDC  sy-tem  is  applicable  to  all 
functions  outlined  in  A  KM  66-1,  and  requires  that 
all  maintenance  actions  involving  direct  labor  ex¬ 
penditures  be  ri-c  irdcd  and  reported  In  this  system 
unless  exempted  by  TO  Oh -2D  2.  The  sjstem  is  ap¬ 
plicable  to  the  life  ode  of  aircraft,  missiles,  ground 
communications,  electronics,  and  meteorological 
equipment,  and  related  end  items  beginning  with 
operational  test  and  evaluation  as  described  in  AFK 
60- 1 4.  This  includes  compatible  data  reporting  on 
contractor  maintained  equipment  and  maintonanco 
accomplished  in  depot  facilitiea. 

6-4.  DOCUMENTATION  CONCEPT  The  A I  TO 
Forma  .H6.  349,  and  3M1  are  used  as  source  docu¬ 
ments  for  the  maintenance  data  collection  system. 

a.  Recording  Concept  procedures  are  divided  into 
tv-o  basic  categories  identified  ns  on  equipment  and 
ofT-equipme nt  maintenance  documentation. 

(1)  Maintenance  actions  accomplished  on  com¬ 
plete  end  items  of  equipment  (aircraft,  missiles, 
removed  engines,  ground  communications  elect rmics- 
meteorologic.il  (CRM),  trainers.  Aerospace  Gr-und 
Equipment  (AGO  and  nuclear  weapons)  are  identi¬ 
fied  as  on-equipment  work.  Ibis  primarily  consists 
of  support  general  tasks,  inspections,  rrm-iv.it  and 
replacement  of  components,  fix-m  place  maintenance 
actions,  and  modifications. 

(2)  In  shop  maintenance  urtinns  involving  inter¬ 
mediate  level  maintenance,  on  rrmovi-J  components 
Is  Identified  as  off -equipment  n.  lirtenance  fbis 
primarily  consists  of  b»nch  check,  repair  or  mollifica¬ 
tion  of  components  and  assemblies,  and  nondcstruc- 
live  inspection. 
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(3)  If  maintenance  is  done  on  eompunents  that 
are  removed  or  removed  and  roplared  to  facilitate  • 
maintenance  in  the  same  room  or  one  immediately 
adjacent  to  the  end  item;  this  Is  retarded  as  on* 
equipment  maintenance.  If  tho  Individual  'hat  re¬ 
moved  the  component  has  to  leave  the  immediate 
area  (dcflnvd  as  out  nf  right),  an  AFTO  Form  330 
will  bo  prrparcd  tn  identify  tht  status  of  tho  re¬ 
moved  enmpnnrnt.  tn  this  regard,  when  personnel 
front  nne  workcenter  remove  an  item  and  send  it  te 
personnel  with  a  different  workcenter  cede  for 
maintenance,  the  latter  w-orkcenter  will  record  It  M 
eif-tquipment  maintenance. 

(4)  Due  tn  management  requirement*,  unique 
procedures  exist  for  engines.  All  maintenance  ac¬ 
complished  nn  gas  turbine  and  reciprocating  engines 
installed  in  airrraft,  missiles,  or  AGE  will  be 
recorded  as  on  rquipment  maintenance.  Removal  and 
replacement  of  gas  turbine  nnd  reciprocating  engines 
for  aircraft,  missiles,  or  AGE  will  bo  recorded  as 
on-cquipment  maintenance  with  the  engine  treated 
as  a  component.  Shop  work  on  all  removed  gas  tur¬ 
bine  engines  nnd  aircraft  reciprocating  engines  will 
be  treated  as  end  item  maintenance  with  on-equip¬ 
ment  and  olT  i-quipment  recording  concepts  applying, 
(TO  00-2(6-2-4).  Shop  work  nn  reciprocating  en¬ 
gines  removed  from  AGE  will  b*  treated  as  com¬ 
ponent  maintenance  and  tho  off-oquipmtnt  mainte- 
nance  concept  will  apply. 

(6)  Each  work-center  participating  in  a  jeb  will 
record  maintenance  actions  and  labor  expenditures. 
The  documentation  responsibility  rests  with  the 
senior  representative  from  the  workcenter-  Thess 
documents  will  be  returned  to  the  workcenter  super¬ 
visor  w  ho  will  check  for  accuracy  and  completeness 
prior  to  submission  for  processing, 
b.  Onto  Forma: 

(I)  Use  of  the  AFTO  Form  349.  Th*  AFTO 
Form  349,  "Maintenance  Data  Collection  Record." 
was  drsignrd  with  sufficient  flexibility  for  us*  by  the 
majority  of  organisations  in  recording  maintrnanc* 
actions  on  various  types  of  equipment.  Recording 
nnd- data  collection  procedures  pertaining  to  this 
form  srs  outlined  in  the  00-20-2-itrie*  technical 
orders. 

(a)  For  on  equipment  work  tht  primnry 
entries  required  on  the  AFTO  Form  319  ore  block  I 
(Job  Control  Number),  block  2  (Workcenter).  block 
•7  (ID  Number),  block  6  (Time,  .is  applicable),  and 
columns  FI  through  K  For  in-shop  engine  work, 
primary  entries  are  required  in  blocks  l  and  2. 
block  1  (  Engine  1 1) )  and  in  column*  B  through  K. 
For  olf- equipment  work  nn  removed  components, 
primary  entries  are  required  in  blocks  I.  2,  nnd 
block  J  or  5;  block  19  (Federal  flupplv  Class 
(FSC>),  block  20  (Part  Number),  and  columns  8 
through  K. 

,1'  Up  to  fu*  related  on-cquIpmcnt  mainte¬ 
nance  nctluns  eovrrnl  bv  a  single  Job  control  num  ber 
ug.iinst  n  single  III  number,  nnd  accomplished  by  a 
single  workcsntsr  may  be  rsportsd  en  ■  single  copy 
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•f  the  AFTO  Form  319.  If  mo r*  action  linen  art 
required,  another  A  I’ TO  Korin  349  containing  the 
Mint*  job  control  number,  II)  number  and  workccntor 
emit  is  completed  and  the  artnnt  rnntimn'd.  This 
recording  procedure  also  applies  to  off -equipment 
action*;  how ever,  on  equipment  ami  off-equipment 
action*  Mill  not  he  ominned  on  a  tingle  copy  u f  the 
AFTO  Form  349,  The  four  item*  could  be  reported 
by  a  single  line  entry  it  the  job  control  number,  work 
unit,  action  tukon,  how  malfunctioned  and  when 
discovered •codes  are  all  the  same  and  u  unit  count 
of  four  I*  entered.  Similarly  the  AFTO  Form*  330 
prepared  for  (hep  procesulng  of  the  four  black  boxe* 
otoy  reflect  a  quantity  of  more  than  one  only  if  the 
Job  control  number,  work  unit  code,  federal  supply 
close  and  part  number  are  the  eame,  If  these  ele¬ 
ments  are  dilferent,  it  separate  AFTO  Form  350 
must  be  prepared  for  each  item.  Serial!  •  controlled 
and  time  change  items  (with  an  asterisk  in  the  work 
anil  code  manual)  must  be  recorded  on  an  individual 
basis,  (for  example,  only  one  item  per  AFTO  Forms 
349  and  350). 

(c)  The  AFTO  Form  3 19  can  be  used  IjT 
Identification  of  both  t lie  end  item  of  equipment  and 
a  component  for  engine  change  actions,  for  weapon 
systems  and  equipment  that  are  managed  under  the 
Advanced  Configuration  Management  System 
(ACMS),  for  time  change  items,  lor  special  report¬ 
ing  on  tires,  and  for  reporting  olf  equipment  mainte¬ 
nance  actions 

(2)  Use  of  the  AFTO  Form  350.  The  AFTO 
Form  350,  "Reparable  Item  Processing  Tag,"  is  a 
two-pert  perforated  form  that  is  attached  to  com¬ 
ponents  (hat  are  removed  from  equipment  end  items 
and  serves  as  an  identification  and  status  tag.  An¬ 
other  important  aspect  of  tins  form  is  that  it  serves 
as  a  source  document  pertaining  to  Repaired  This 
Station  (RTS),  Not  Repaired  This  Station  (NRTS), 
end  eoiid“mnaiion  actions  for  the  supply  system. 
This  Information  u  input  to  the  base  supply  com¬ 
puter  to  identify  blockage  requirements.  Information 
pertaining  to  RTS,  NRTS,  and  condomnotiohs  is  also 
forwarded  through  the  supply  system  to  AF’I.C  as 
factors  for  computing  the  world-wide  spares  re¬ 
quirements.  Recording  procedure*  for  tne  AFTO 
Form  350  are  outlined  in  the  00-20-2-series  technical 
orders. 

(3)  lire  of  tne  AFTO  Form  316,  "Maintenance 
Data  Collection  Production  and  Scheduling  Record. " 
The  AFTO  F'orm  3(6  is  used  foi  scheduling  the 
calibration  of  Precision  Measuring  Kquipmcnt 
(PMF)  and  for  recording  all  maintenance  on  preci¬ 
sion  measurement  equipment  for  input  to  the  MDC 
system.  The  AFTO  Furm  3 It;  may  also  be  used 
for  scheduling  calendar  maintenance  requirements 
on  any  equipment  within  the  maintenance  complex. 
Note  that  this  pertains  only  to  calendar  require¬ 
ments.  Scheduling  procedures  prrtainr  g  to  the 
AFTO  F'orm  346  arc  outline, j  in  AF'R  66  267,  Main¬ 
tenance  recording  procedures  for  the  AFTO  F'orin 
346  on  FME  are  outlined  In  TO  00-20-10-6 

C.  Data  Elements: 

(1)  Job  Control  Number  !JCN).  The  JCN 
pnsists  of  seven  characters,  the  first  three  are  the 
ultan  date  and  the  lust  four  are  n  unique  job  number 
for  that  date.  This  provides  a  means  to  tie  together 
■II  on-  and  off-equipment  actions  taken,  mnn-houts 


expended,  and  parts  consumed  to  satisfy  a  mainte¬ 
nance  requirement  whether  it  be  a  discrepancy,  an 
itupei'liun,  or  a  '1  CTO.  Every  action  taken  that  Is 
rclnt -d  to  u  job,  regardless  of  worketnter,  time  or 
place,  will  carry  the  name  job  control  number  that 
vv;r.  originally  assigned  to  the  job.  This  procedure 
it  necessary  t)  permit  control  of  nil  related  actions, 
and  to  provide  the  capability  to  tic  them  together  in 
data  systems  to  identify  tho  total  job  for  anulvais 
purpose*. 

(2)  Workccnter  Code.  Tho  worketnter  codo 
consists  of  five  characters  that  identify  organisa¬ 
tional  elements  to  which  maintenance  personnel  are 
assigned,  or  locations  to  which  they  may  bo  dis¬ 
patched.  Standard  workccnter  codes  are  used  by  all 
organisations  engaged  in  tho  maintenance  functions 
outlined  in  AFM  66-1.  In  general,  the  code  entered 
in  the  workcentcr  block  of  the  AFTO  F'orm  349 
indicates  the  workcentcr  cf  the  Individual  doing  the 
work  and  not  necessarily  w  acre  the  work  is  accom¬ 
plished. 

(3)  Identification  (ID)  Number.  The  ID  num¬ 
ber  consists  of  six  characters,  and  is  used  to  identify 
equipment  on  which  work  was  performed  or  from 
which  an  item  was  removed.  The  first  charucter  of 
the  ID  number  is  the  first  character  of  the  owning 
workccnter  code,  The  second  character  of  the  ID 
number  is  the  first  character  (prefix)  of  the  equip¬ 
ment  classification  code  such  at  A  for  aircraft,  B 
for  Ground  Radar  or  M  for  Ground  l.aunehed 
Missiles  (AFM  300-4,  A1)E  MA-I56-XI).  The  last 
four  characters  of  the  !D  •  umber  normally  arc  the 
last  four  positions  of  the  t.,uipment  serial  number, 
Detailed  procedures  for  assigning  ID  numbers  arc 
contained  in  AFM  66-267. 

(4)  Equipment  Classification  Code.  The  equip¬ 
ment  classification  code  consists  of  three  characters, 
and  is  assigned  to  identify  aircraft,  missiles,  ground 
communications,  electronics,  and  meteorological 
equipment,  AGE,  trainers,  engines,  ground  launched 
missile  real  properly  installed  r  nipment,  munitions, 
and  precision  measurement  equipment.  Codes  are 
also  assigned  for  research  and  development  and 
shop  work.  Most  of  the  equipment  classification 
codes  are  assigned  to  specific  equipment  such  as 
LGM-30R  missiles.  Some  of  th*  codes  are  assigned 
by  category  of  equipment  or  work  such  as  non- 
registered  AGF.  and  shop  work  that  is  not  identified 
to  a  weapon  or  support  system.  The  uuthomed 
equipment  classification  codes  ar*  contained  in  TO 
00-20-2. 

(5)  Type  Maintenance  Code.  The  type  mainte¬ 
nance  code  consists  of  one  character  and  is  used  to 
identify  the  type  of  work  that  was  accomplished 
surh  us  scheduled  or  unscheduled  maintenance.  Type 
maintenance  codes  are  listed  in  each  work  unit  code 
manual  for  individual  types  of  equipment.  A  com¬ 
plete  list  of  authorized  type  maintenance  codes  is 
contained  in  AFM  300—1,  volume  XI. 

(0)  Work  Unit  Code.  Tho  work  unit  code  con¬ 
sists  of  five  characters,  and  is  used  to  identify  the 
system,  subsy  stem,  ond  component  on  which  mainte¬ 
nance  is  required  or  on  which  maintenance  was  ac¬ 
complished.  These  codes  are  published  in  work  unit 
code  manuals  for  each  weapon  and  support  system 
and  in  code  manuals  by  type  cf  equipment  for  se¬ 
lected  ground  CE.M,  :.ruiners,  AGE,  munitions,  PME, 
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and  shop  wort;.  A  limit'd  number  of  work  unit  codec 
are  assigned  in  a  special  ntt'i:nry  *n  identify  tusks  of 
a  general  nature  stirh  ns  >>'|ui| men1,  servicing.  clean 
ing,  inspection,  s'or.rgo  prnmd  safety,  record  keep¬ 
ing,  weapon*  handling,  and  repetitive  simp  task*. 
Although  they  are  work  unit  endcs,  they  aie  identi¬ 
fied  #1  "Support  General  Codes.’*  The  first  two  posi¬ 
tions  of  the  work  unit  codes  for  aircraft,  ground 
rtldar,  and  missiles  are  Mnndnrd  system  codes.  They 
identify  functional  systems  such  a*  flight  control 
system,  code*  antenna  system,  or  launch  control  sys¬ 
tem.  The  first  two  positions  of  the  work  unit  codes 
for  support  equipment  identify  types  of  equipment, 
such  as  ground  powered  generator*,  or  end  items 
of  equipment,  such  as  a  trainer.  The  first  position  of 
support  general  codes  begin  with  n  zero;  nml  this  is 
standard  in  all  work  unit  code  manuals.  The  third 
and  fourth  positions  of  the  work  unit  code  identify 
subsystem  or  major  assembly.  The  fifth  position  of 
the  work  unit  code  normally  identifies  r-emirable 
items. 

(7)  Units  Completed.  The  work  unit  code  in 
combination  with  an  action  taken  code  Is  used  to 
describe  a  "unit  of  work."  An  entry  of  one  or  more 
units  completed  must  also  be  made  in  the  UNITS 
block  of  the  data  collection  form  in  order  to  show 
a  completed  action.  An  example  of  a  unit  of  work 
would  be  a  work  unit  code  fur  an  antenna,  with  an 
action  taken  code  for  removed  and  replaced,  and  a 
unit  count  of  one,  for  example,  one  antenna  removed 
and  replaced.  Hy  using  additional  codes  to  identify 
the  rnd  item,  the  typo  «.f  maintenance  being  accom¬ 
plished,  when  the  maintenance  requirement  was  dis¬ 
covered,  how  the  item  malfunctioned,  ami  the  time 
expended  in  accomplishing  llu>  work,  and  the  produc¬ 
tion  credit  system  also  provides  information  essential 
for  maintenance  and  mr.lrrirl  management. 

(8)  Action  Taken  Code.  The  action  taken  emir 
consists  of  one  character  used  to  identify  the  mainte¬ 
nance  action  that  was  taken,  such  as  remove  and 
replace.  Action  taken  codes  ore  standard  for  all 
equipment  nnd  are  listed  in  all  work  unit  rode 
manuals.  A  complete  list  of  authorized  action  taken 
codes  is  contained  in  AFM  -700  i,  volume  XI. 

(9)  When  Discovereo  Code,  The  when  discovered 
code  consists  of  one.  character  and  is  used  to  identify 
when  a  defect  or  maintenance  requirement  was  dis¬ 
covered,  such  ns  during  a  quality  control  inspection. 
When  discovered  codes  arc  listed  in  each  work  unit 
code  manual  for  individual  types  of  equipment.  A 
complete  list  of  authorized  when  discovered  codes  is 
contained  in  AFM  1,  volume  XI,  Only  that  per- 
tion  of  the  when  discovered  rode  definition  that  ap¬ 
plies  to  equipment  listed  in  ihc  work  unit  code 
manual  Is  to  he  used.  For  example,  when  discovered 
code  M,  In-Flight-No  Aborl/Pui  in*  AGK  Operation, 
srould  be  listed  in  the  A G I :  work  unit  code  manual 
*»  D,  During  ACM  Operation. 

(!0)  How  Malfunctioned  Code,  The  huw  mal¬ 
functioned  cede  convists  of  tbiee  character!  and  is 
used  to  Identify  how  the  equipment  malfunctioned, 
zuch  ns  crrvci'cd.  To  prpviil"  maximum  utility,  these 
code*  arc  also  used  to  identify  lime  compliance  tech¬ 
nical  order  status  requirement*,  or  to  show  that  a 
maintenance  action  did  nn(  result  from  a  defect.  A 
complete  list  of  authorized  how  malfunctioned  endr.s 
It  contained  in  AFM  3U0-I,  volume  XI,  in  both 


alphabetical  (definition!  nnd  numerical  (code)  se¬ 
quence,  Only  those  Imw  malfunctioned  code*  that  are 
applicable  will  be  listed  in  rarh  work  unit  coda 
ninnu.il.  For  example,  how  malfunctioned  code*  ap¬ 
plicable  only  to  a  solid  rocket  missile  will  not  be 
listed  in  a  ground  CKM  work  unit  end*  manual.^ 

Note:  Due  to  Hie  nature  of  support  type  work, 
(he  recording  of  actum  taken,  when  discovered, 
and  how  malfunctioned  codes  is  nn(  required 
with  support  general  work  unit  codes. 

9-S.  The  foregoing  paragraphs  of  this  chapter  de¬ 
scribe  the  MPC.S  objectives  and  reporting  concept  ns 
related  to  the  bn3e  maintenance  environment.  In 
order  to  provide  AFI.C  data  on  maintenance  events 
as  they  occur  worldwide,  most  of  the  data  docu¬ 
mented  at  AF  bases  under  the  TO  00-20-2  scries  are 
submitted  to  IIQ  AFI.C  for  use  in  logistic  support 
nnd  related  engineering  decisions.  These  data  arc 
received  nnd  processed  centrally  at  HQ  AFI.C  in  the 
DOfifi  Product  Performance  System.  This  data  sys¬ 
tem  not  only  receives  and  output  reports  containing 
Reliability  and  Maintainability  (R  and  M)  factors 
within  its  established  computer  programs  but  also 
services  other  interfacing  data  systems  with  source 
data.  Some  of  the  interfacing  data  systems  alia  out¬ 
put  reports  containing  It  ami  M  factors  individually 
unique  to  their  rsbthlishcd  computer  program  con¬ 
trol*.  Figures  9-1  through  9-18  illustrate  the  data 
flow  from  point  ni  origin  through  the  D036  major 
system  processes  and  to  other  inter faciiih'  systems 
which  are  drivin  by  the  same  source  data.  The  fol¬ 
lowing  pages  of  this  chapter  explain  some  of  the 
arms  used  in  the  |)OfiG  and  samples  of  output 
rports  containing  R  and  M  factors;  however,  for  a 
full  understanding  or  system  capabilities  refer  to 
AFI.CM  CG-15  and  171-45. 

9-fi.  Definitions  of  It  and  M  parameters  and  terms 
used  in  the  l)Of>G  data  system: 

a.  Type  tlovv  Malfunctioned  Codes. 

(1)  Type  1 — These  codes  indicate  that  the  item 
no  longer  can  meet  the  minimum  specified  perform¬ 
ance  requirement  due  to  its  own  internal  failure 
pattern. 

(2)  Type  2 — These  endn  Indicate  that  the  item 
can  no  longer  meet  the  specified  performance  re¬ 
quirement  due  to  seme  induced  condition  and  not 
liuc  to  it-*  own  internal  failure  pattern. 

(.7)  Type  G— These  codes  indicate  maintenance 
resources  were  expended  due  to  policy,  modifications, 
item*  location,  rannihalizntinn  and  other  no  defect 
conditions  existing  at  the  time  mainttnunce  was 
accomplished. 

b.  Failure  nrcurrcnces.  The  computer  definition  of 
a  failure  occurrence  related  to  a  Work  Unit  Code  is: 
"any  Type  1  Mow  Malfunctioned  cod*  reported  In 
rnmhjnntion  with  on  action  token  indicating  repair, 
uljusiment  or  Item  replacement  and  ona  or  mors 
mils  produred. 

c  Quattlily  per  Appllralinn  (QI’A).  This  Is  the 
luanlily  nf  identical  installed  items  on  a  sin  gls  unit 
;f  equipment  that  arc  reportabls  undsr  tbs  asm* 
work  unit  code. 

Copy  available  to  DTIC  (too*  no. 

permit  tullx  legible  lep.iodu  iUon 


114 


MAIIJTDIANCE  DATA  COLLECTION  SKSTB4 
KCFOKl'INO  AT  AF  BASES 

* 


Aah'LKmF.mv 

Corrective  and  Preventive 
Maintenance  at  or  on  the 
Aircraft  or  Equipment 


"orr"  EQiriPMENT 

Corrective  and  Preventive 
Maintenance  Accomplished  in 
Repair  Shops  on  Items  Remove*. 
From  Aircraft  or  Efeulomaat 


| Encoded  on  AFTO  fora  3^9  ^  Base  Data  Automation  ^ 

For  Computer  Processing 


Encoded  on  AFTO  Form  3**9 


X 


Preformatted  Data 
For  AFLC 

RCS:  L0G-:310(AR)71'*2 


3slAS& 


Autodla 


Hail 


|Locai  Manageoent  Reports 


Spa 

Das 


Special  Study  Reports 
e  Level  Inquiry  Systen 


Selected  Data  for 
MAJCGM 


,  -  ---V  *■  V-  i  "2* 

*  %  j*,*  -  J^. 


>.%v 


fl 
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AFLC  D056  HOrri'KLY  CCMI’UTEH  PROCESSES 


s 


Data  From  D0^6  l/eekly  Processes 


Source  Data  to  Interfacing  Systems  ! 

V  -  | 

Logistic  Cost  Ranking  System  j 

Operating  at  Sacramento  ALC  j 


Flight  Safety  Prediction  Technique] 
Operating  at  San  Antonio  ALC  t 


Analytical  Interval  Determination 
For  Depot  Level  Maintenance 


Department  of  Defense  Contractors 


Data  From  Interfacing  Systems 


Part  Number  to  Stock  Number 
Identification,  Unit  Price  and 
AF  Mgt  Activity  From  Federal 
Cataloging  System 


Identification  of  the  Item 
Manager  Technician  and  Division 
Within  the  AFLC  Air  Materiel  Area 


Flying  Hours,  Inventory,  Sorties 
and  Lauding  From  the  Aircraft 
Status  Reporting  System 


Accident,  Incident  and 
Jdnergency  Unsatisfactory 
Materiel  Report  Data  From  the 
AFLC  AF  Materiel  Safety  Office 


D056  Output  Reports 


D056  Data  System  Evaluation  Reports 

Reports  Designed  for  Evaluation  of  Hardware 
and  Maintenance  Performance  Related  to 
Individual  Weapons  and  Equipment 

Reports  Designed  for  Evaluation  of  Hardware 
and  Maintenance  Performance  Related  to 
Recoverable  Items 


Precision  Measurement  Equipment 
Calibration  Interval  Analysis7 

Selected  Data  Retrieval  for 
Special  Studies 


.t'ifure  $-3 


A 


d.  Use  Factor  (K,).  This  is  ;\  rotio  of  nclu.tl  use 
time  of  individual  Work  Unit  Codes  to  fiying  hours. 

e.  Mean  Time  Between  Failure  Occurrence 
(MTBF). 

MTBF  ss  End  Item  Operating  Time*  x  K,  x  QPA 
Quantity  of  Failures 

•End  item  operating  time  is  determined  a*  *• 1 
..lows: 

For  aircraft— active  aircraft  inventory  flying 
time  from  AFM  65-110. 

For  other  equipment — Active  inventory  flying 
time  from  AFM  65-110. 

f.  Mean  Time  Between  Maintenance  Occurrence 
(MTB.M). 

MTBM  =  End  item  Operating  Time*  x  QPA 

Quantity  of  Data  Maintenance  Occurrences* 
•All  types  of  actions  described  in  paragraph 
9-6  a. 

K-  Action  Limit  (AL).  This  is  a  form  of  failure 
limit  expressed  in  MTBF  (hours)  and  used  in  the 
computer  program  to  compare  current  failure  rates 
with  past  history  for  the  same  item. 

h.  Failure  Limit.  This  is  the  acceptable  quantity 
»,f  failures  of  an  item  for  a  30-day  period.  It  is  as¬ 
signed  by  the  system  manager  and  u:rd  in  the  com¬ 
puter  program  to  compare  current  period  failures 
with  past  history  for  the  sams  item. 

9-7.  1)056  OUTPUT  REPORTS  Selected  reports  con¬ 
taining  R  and  M  related  data  are  identified  and  briefly 
described  in  the  following  subparagraphs. 

a.  Selected  Work  Unit  Code.  Conlrnl  Identifier, 
RCS:  LOC-MMO(Ait)' I6t>.  This  report  provides 
■ummarized  information  on  Work  Unit  Codes  within 
a  weapon  for  the  current  reporting  period  that 
breeched  either  the  Action  Limit  or  Failure  Limit; 
had  Emergency  Unsatisfactory  Materiel  Reporting; 
were  high  man-hour  consumers  or  were  high  corro¬ 
sion  repair  man-hour  consumers.  This  report  Is  used 
as  a  management  reference  to  identify  items  that 
may  warrant  detail  study  and  evaluation.  Sample 
report  Figure  3-4. 

b.  Detail  Maintenance  Actions  for  Srlcclcd  Work 
Unit  Codes,  RCS:  LOG-MMOf A!1)7I67.  This  report 
provides  one  to  twelve  months  o*  "on"  equipment  in¬ 
formation  on  Work  Unit  Codes  within  a  weapon  for 
detail  studies.  It  is  available  only  on  special  inquiry 
and  can  be  limited  in  data  presentation  by  selective 
retrieval  options.  (Sample  Report  Fig  3-5.) 

e.  Detail  Shop  Actions  (nr  Selected  Work  Unit 
Codes,  RCS:  LOG-MMO(AU)7ir.S.  This  report  is  a 
companion  report  to  paragraph  !)-7li  and  provides 
detail  information  from  supporting  repair  simps  on 
reparable  items  removed  from  a  weapon.  It  also 
displays  parts  replaced  during  shop  repair.  (Sample 
Report  Fig.  9-6.) 

d.  Summsriicd  Maintenance  Actions  (or  Selected 
Work  Unit  Codes:  RCS:  LOG-MMOf Alt )7 ir>!»,  This 
report  provides  the  same  type  of  information  ss 
described  in  paragraphs  9-7h  and  c  but  with  lesser 
detail.  It  ll  produced '  s\  hen  the  Action  or  Failure 
Lirrut  Is  breeched  and  also  by  special  inquiry  using 


selective  retrieval  routines.  (Sample  Report  Fig. 
3-7.) 

e.  Maintenance  Artinns,  Man-hours  and  Aborts  by 
Work  Unit  Code,  RCS:  f.OG-MMO(AR)7170.  T?  is 
report  provides  si*  months  of  selected  information 
by  month  on  every  reportnhle  Work  Unit  Coda  as¬ 
signed  to  a  particular  weapon  nr  equipment.  This 
Information  includes  aborts,  failures,  maintenance 
actions,  MTHF,  MTflM  and  man-hour*.  Both  **on’* 
and  "off"  equipment  data  are  considered  for  display 
In  this  report  (except  for  *ome  typ*s  of  AGE, 
trainers  and  munitions).  (Sample  Report  Fig.  9-6.) 

f.  Aborts  and  Degraded  Alerts,  RCS:  LOG- 
MMO(Alt)7l7l.  This  report  provides  current  month 
detail  Information  on  Work  Unit  Codes  and  part 
numbers  causing  aborts,  mission  failures  and  de¬ 
graded  alerts.  For  ground  equipment,  this  report 
identifies  items  causing  equipment  downtime.  (Sam¬ 
ple  Report  Fig.  9-9.) 

g.  Materiel  Safety  Deficiency  Report,  ItCS:  LOG— 
MM0(M)7|78.  This  report  provides  twelve  months 
of  selected  information  for  Work  Unit  Codes  appli¬ 
cable  to  a  Mission  Design  Series  aircraft  that  have 
been  reported  at  contributing  to  an  accident  or 
incident  or  have  been  the  subject  of  sn  Emergency 
Unsatisfactory  Materiel  Report.  Any  of  the  above 
events  having  occurred  within  the  past  twelve 
months  and  recorded  In  the  L)05C  system,  drives  the 
computer  to  display  failure  rate,  trending  and 
predictive  maintenance  experience  data  in  this  report 
as  well  as  the  quantity  of  hazard  conditions  reported. 
(Sample  Report  Fig.  9-10.) 

h.  Work  Unit  Code  Corrosion  Summary,  RCS: 
LOG -MM  ()( A  11)717!).  This  report  provides  three 
months  of  information  on  a  weapon  or  equipment 
identifying  Work  Unit  Codes,  number  of  units,  man¬ 
hours  and  labor  coat  lor  corrective  maintenance  due 
to  corrosion.  The  25  Work  Unit  Codes  incurring  the 
highest  corrosion  repair  cost  arc  rank  ordered  and 
displayed  separately  in  the  report  for  ease  of  identifi¬ 
cation.  (Sample  Report  Fig.  9-11.) 

i.  System,  .Subsystem  Corrosion  Summary,  RCS: 
LOG-MMO(AK)7I80.  This  report  is  produced  as  a 
comparison  report  to  h  above  using  the  same  three 
months  of  corrosion  repair  data  except  that  the  in¬ 
formation  is  summarized  to  system/subsyetem  level 
end  base  location.  (Sample  Report  Fig.  9-12.) 

j.  System,  Subsystem,  Wmk  Unit  Code  Failure 
Summary,  ItCS:  LOG-MMOf  AR)7)83.  This  report 
provides  twelve  months  of  information  related  to 
current  quarter  experience  for  systems,  selected  sub¬ 
systems  and  Work  Unit  Codes  on  an  aircraft.  The 
data  displayed  is  rank  ordered  by  system,  subsystem 
within  system  and  Work  Unit  Code  within  subsystem 
bared  on  the  quantity  of  failures  incurred.  Informa¬ 
tion  displayed  includes  the  quantity  of  failures, 
MTBF,  and  n  ratio  of  current  quarter  to  tha  last 
twelve  months  experience.  (Sample  Report  Fig. 
9-13.) 

k.  Failure  Rate  Data  for  Selected  Work  Unit 
Code  i.  RCS:  LOG-M.MO(AII)7I8I.  Thlj  report  pro¬ 
vide*  twelve  month*  of  informotlon  qunrterly  uhtn 
the  Action  Limit  I*  breeched  and  also  by  special  In- 
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«jv*ry  using  selective  retrieval  routines,  Information 
displayed  Include  t  current  quarter,  previous  quarter 
•n<l  12-month  MTI1F,  quarter  to  12  month  ratio  and 
data  groupings  by  when  dlacuvcred,  action  taken,  how 
malfunctioned  and  base  locution,  (Sample  Report 
Fig.  fl-H.) 

l.  Meinlensnce  Msn-hours  per  Flying  Hour  hy 

Weapon,  Conuna.id  and  Sytirm,  KCS:  L(H<- 

MMO(Alt>7Uj  This  report  provide*  12  months  of 
Information  updated  quarterly.  The  data  displayed 
and  tha  related  computations  are  as  indicated  in  the 
report  tills.  (Sample  Report  Fig.  0-15.) 

m.  Maint.iinabitily  Keli.ihiliiy  Summary,  RCS: 

LOG-M,M0(AK)722O.  This  special  inquiry  report 

provides  12  months  of  information  on  Work  Unit 
Codes  within  an  aircraft.  Information  displayed  in¬ 
clude*  failure,  maintenance  action,  abort  and  man¬ 
hour  rates  as  well  as  the  most  predominate 
malfunction  mode*.  (Sample  Report  Fig.  9—16.) 

n.  Selected  Part  Number  Action  Summary,  RCS: 

1X>U-.MM0(AI{)71*S.  This  report  provides  12 

months  of  information  on  a  recoverable  lino  item  of 
supply  (part  number  worldwide)  regardless  of  its 


lintalted  us*  environment.  It  It  produced  when  the 
e-  iMpuled  failure  limit  for  sn  item  (Federal  Stock 
Number)  it  breeched  and  also  by  special  Inquiry. 
The  information  displayed  docs  not  reflect  mainte¬ 
nance  required  while  installed  in  a  weapon  or  equip¬ 
ment.  It  is  limited  to  "off"  equipment  (shop  and 
depot)  repairs.  (Sample  report  Fig.  •>)?.) 

o.  Maintenance  Actions  tor  Selected  FUN  Num¬ 
bers,  ItCS:  I.OG-M  MO{  A  It  )T  119.  This  report  pro¬ 
vides  six  months  of  "otP*  equipment  (shop  and  depot 
repair)  information  on  a  recoverable  item.  Informa¬ 
tion  displayed  includes  quantities  of  maintenance 
actions,  malfunction  modes,  nnd  base  location.  It  la 
produced  when  the  computed  failure  limit  for  an 
item  (Federal  Stock  Number)  is  breeched  and  also 
by  apeciat  inquiry. 

p.  Parts  Replaced  During  Field  or  Depot  Repair, 
RCS:  LOG-.M.MO(Alt)t:90.  This  rsport  la  produced 
on  the  same  criteria  as  above  displaying  six  months 
of  parts  replaced  during  repair  of  items  identified 
in  the  KCS:  I-OCI-MMOf  A1U7189.  Information  also 
displays  quantity  and  reason  for  replacement  (Sam¬ 
ple  report  Fig.  9-18.) 
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APPENDIX  B 


The  Operational  Audit  Technique 

When  there  are  task  times  and  frequencies  that  can  not 
be  attained  using  other  techniques ,  these  estimates  are 
based  on  the  combined  experience  and  background  of  the 
manpower  management  technician,  the  specialist,  and  super¬ 
visory  personnel.  Estimates  are  made  at  the  highest  level 
of  activity  that  gives  confidence  in  the  validity  of  the 
estimate  and  requires  the  continuous  use  of  defined  work 
crews  and  equipment.  Air  Force  Regulation  25-5,  Volume  II 
describes  this  method  of  work  study. 

It  should  be  emphasized  that  other  methods,  work  mea¬ 
surement  or  work  sampling,  are  recommended  whenever  fea¬ 
sible.  In  some  instances  these  traditional  techniques 
provide  back  up  and/or  bias  checks.  Some  of  the  tasks 
included  in  this  study  have  been  subjected  to  work  study 
and  to  resultant  times  for  these  tasks  were  compared  to 
the  estimates  provided  by  specialists.  As  discussed 
earlier  (see  page  25) ,  either  method  produced  nearly  iden¬ 
tical  task  time  estimates. 

In  the  conduct  of  these  interviews  it  was  necessary  to 
assess  the  specialist  and  his  degree  of  understanding  of 
the  research  requirement  and  ability  to  give  "average"  task 
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times.  In  some  cases  it  was  necessary  to  estimate  shortest 
and  longest  times  for  a  given  task  and  then  obtain  an 
opinion  as  to  whether  most  such  tasks  tend  toward  the  high 
or  low.  However,  this  researcher  found  that  each  specialist 
quickly  grasped  the  concept  and  provided  realistic  esti~ 
mates  whenever  his/her  experience  included  the  particular 
task. 

Although  a  completely  "standard"  survey  form  or  technique 
was  not  possible  due  to  the  differences  in  background,  know¬ 
ledge  and  perception,  the  general  technique  illustrated  by 
the  example  in  this  appendix  was  used  with  each  interviewee. 
Each  specialist  was  either  contacted  by  the  researcher 
initially  or  asked  by  his  supervisor  to  help  the  researcher 
determine  maintenance  task  times. 

Due  to  the  various  conditions  under  which  maintenance 
is  performed  and  the  wide  variety  of  maintenance  activities 
and  experience  this  researcher  does  not  recommend  that  a 
standard  survey  form  or  approach  be  developed.  Current 
analysts  working  in  this  area  have  operations,  maintenance, 
manpower,  or  engineering  backgrounds.  Most  have  a  combina¬ 
tion  of  them,  and  all  are  trained  thoroughly  before  con¬ 
ducting  the  interviews.  Also  the  analyst  who  conducts  the 
operations  audit  is  involved  in  all  other  phases  of  the 
study . 

This  analyst  does  recommend  that  further  research  be 
conducted  to  determine  the  number  of  duplicate  interviews 
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that  are  required  to  determine  the  variance  of  task  time 
estimates.  By  duplicating  the  interviews,  problems  of  bias 
or  random  error  may  be  detect'd  that  were  heretofore  unknown. 

For  this  study  operational  audits  were  conducted  at 
Seymour  Johnson  Air  Force  Base  during  several  visits  during 
1979.  From  the  work  unit  code  manual  for  the  selected  ex¬ 
ample  aircraft  each  maintenance  specialist  identified  all 
tasks  for  which  his/her  specialty  is  responsible.  Bach  task 
was  identified  for  the  type  of  work  (remove  and  replace, 
repair  on  aircraft,  troubleshoot,  inspect  and  verify,  etc.) 
required  when  a  write  up  (discrepancy)  has  occurred.  The 
specialist  was  then  asked  to  estimate  the  time  required  to 
complete  each  task  when  the  work  is  performed  by  (1)  5-level 
and  then  (2)  3-level  maintenance  personnel.  Maintenance 
crew  size,  rework  probabilities,  safety  and  other  related 
information  was  also  requested  from  each  specialist. 

Operational  audit  interviews  were  conducted  with  two  or 
more  specialist  for  each  specialty.  Usually,  the  shop  chief 
or  the  most  experienced  non-commissioned  officer  (NCO)  was 
interviewed  first.  Then  some  of  the  experienced  specialists 
were  interviewed  in  order  to  verify  the  task  times.  In  all, 
nearly  fifty  specialist  were  interviewed  during  the  opera¬ 
tional  audit  process.  All  interviews  took  place  in  the  main¬ 
tenance  shops  or  on  the  flight  line. 

Specialists  were  generally  willing,  even  anxious,  to  be 
interviewed.  When  the  proper  rapport  had  been  established 
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the  interviewees  seem  intent  upon  giving  good  (realistic) 
estimates  for  the  task  times  in  their  specialty.  They  often 
seemed  glad  that  someone  was  taking  an  interest. 

The  transcript  of  one  of  these  interviews  is  included 
here  as  an  example  of  the  technique  that  was  used  to  collect 
the  task  times  for  this  research. 

The  following  is  the  transcript  of  an  interview  by 
Captain  Larry  Howell  with  Master  Sergeant  Widumus  who  is 
Non-Commissioned  Officer  in  Charge  (NCOIC)  of  the  Fire 
Control  and  Radar  Section  for  F-4E  aircraft  at  Seymour 
Johnson  Air  Force  Base,  North  Carolina. 

The  interview  was  one  of  many  conducted  during  June 
1979  in  support  of  a  skill  level  effort  study  being  con¬ 
ducted  by  Captain  Howell. 

h  Hi.  I'm  Captain  Larry  Howell.  I'm  from  Wright- 

Patterson  Air  Force  Base  and  I'm  here  in  connection 
with  a  study  that  seeks  to  determine  the  differences  in 
aircraft  maintenance  performed  by  3-level  maintenance 
specialists  as  opposed  to  5  or  7  level  repairmen.  One 
of  our  primary  tools  is  a  computer  simulation  model 
which  we  use  to  estimate  sortie  generation  capability 
of  a  given  maintenance  operation. 

The  output  of  our  model  looks  like  this  .  .  . 

Some  of  the  required  inputs  include  the  task  times  for 
each  individual  maintenance  task  and  the  probability  or 
likeliness  that  the  task  will  have  to  be  reworked. 
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I  need  your  help  to  go  through  the  work  unit  code  manual 
and  determine  all  the  task*  for  which  your  she  p  is 
responsible,  and  your  estimate  of  the  time  required  for 
a  3,  5  or  7  level  technician  to  perform  the  work. 

Which  APSCs  (Air  Force  Specialty  Codes)  do  you  have  in 
your  shop? 

W  All  the  321s. 

H  Which  areas  in  the  work  unit  code  manual  are  you 
responsible  for? 

W  We  handle  the  74s. 

H  Okay.  Let's  go  through  the  manual  and  talk  about  each 
job.  If  you  would  read  the  five  digit  work  unit  codes 
and  tell  me  what  kind  of  job  you  do  on  each,  whether 
it's  a  repair  on  the  aircraft,  remove  and  replace, 
troubleshoot,  access  or  whatever.  Then  give  me  the 
time  you  think  it  would  take  an  average  5-level  and  the 
average  3-level  to  do  the  job. 

W  Well,  some  of  our  3-levels  aren't  checked  out  yet  so 
they  can't  do  some  of  the  jobs  without  help. 

H  Okay,  we'll  have  to  assume  that  we  are  talking  about 
3-levels  who  are  checked  out,  but  are  not  ready  to 
become  5-levels  yet.  How  long  does  it  take  for  a  new 
3-level  to  become  a  5-level? 

W  It  usually  takes  about  a  year;  some  a  little  more,  a 
few  upgrade  in  about  eight  or  nine  months. 
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H  How  long  does  it  take  to  chock  a  3-level  out  in  all 
the  tasks  that  he  will  be  expected  to  do? 

W  That  depends  on  our  workload.  On  the  average,  maybe  a 
month  or  two. 

H  How  much  extra  training  do  you  nave  to  do  after  a  3- 
level  gets  here  from  tech  school? 

w  Some  can  do  most  everything  the  first  time,  but  most 
need  to  be  watched  for  a  month  or  two. 

H  You  mean  a  5  or  7  level  must  instruct  or  help  them  the 
first  few  times  they  do  each  job? 

W  Yes.  Maybe  four  or  five  times.  That  takes  about  a 
month  or  two  to  get  all  the  jobs. 

H  Okay.  Let's  assume  the  3-levels  we  are  talking  about 
have  been  here  between  two  and  seven  months.  You  might 
tell  me  the  shortest  and  longest  times  you  would  expect 
for  each  task  as  we  go  through  the  work  unit  code 
manual . 

W  Okay. 

H  What's  the  first  work  unit  code? 

W  The  7 4 B AO .  That's  usually  an  R&R  (remove  and  replace). 

H  Okay,  how  long  does  it  take  a  5-level  to  R&R  that  item? 

W  We  always  send  two  men  to  do  the  job.  That's  for  any 

of  our  jobs. 

H  Is  that  for  safety,  or  because  of  weight  or  what? 

W  Yes,  it's  because  one  guy  has  to  be  free  to  handle  the 
power  c?rt,  get  tools,  help  lift  things  and  act  as  a 
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safety  observer. 

Can  you  send  two  3-levels  to  do  the  job? 

Yes,  but  we  try  to  send  one  5  or  7  level  along  with  a 
3-level  so  we  can  get  training  -  get  the  3-level  checked 
out. 

H  Can  two  5-levels  do  the  job  faster  than  one  3-level  and 
one  5-level? 

W  No,  not  really.  As  long  as  there  is  at  least  one  5  or 
7  level  it  doesn't  matter  what  skill  level  the  other 
guy  is. 

H  Is  that  true  for  the  first  time  the  3-level  has  been  on 

the  job  or  after  he  has  been  on  a  similar  task  several 

times? 

W  Well,  it  might  take  longer  if  it's  his  first  time  if 
the  other  guy  takes  time  to  explain  everything. 

H  But  once  he  has  seen  the  job  a  few  times,  a  5  and  a  3 
level  can  do  the  job  just  as  fast  as  two  5s? 

W  Right. 

H  What  if  one  or  both  specialists  are  7-levels? 

W  The  same  as  two  5s  or  a  5  and  a  3.  You  can  only  do  the 

job  so  fast. 

H  Is  this  for  most  jobs  or  just  the  74BAO? 

W  It's  for  all  our  jobs. 

H  Okay,  let's  go  back  to  the  work  unit  code  manual  and 
start  with  the  74BAO.  It's  an  R&R  task.  How  long  for 
a  team  that  includes  a  5  or  7  level? 


That's  about  an  hour  and  a  half  usually.  Sometimes  an 
hour,  sometimes  two  hours,  but  usually  an  hour  and  a 
half.  That's  a  good  average  time. 

How  about  if  two  3-levels  do  the  job? 

Probably  two  hours.  They're  scared  they  might  mess 
something  up.  They  use  the  tech  order  more  too  and  it 
takes  longer  for  them  to  find  things  in  the  T.O. 

Okay,  two  hours  is  the  average  for  the  3-levels,  and  it 
takes  a  crew  of  two.  What's  the  next  work  unit  code? 
The  74BBO.  That's  about  an  hour  and  a  half  for  the 
5-level  and  probably  two  and  a  half  for  the  3-level. 
That's  also  an  R&R  and  a  crew  of  two? 

Yes.  The  74BCO  -  we  fix  that  on  the  aircraft  sometimes 
Say  two  and  a  quarter  hours  for  the  5-level  and  three 
hours  for  the  3-level.  All  of  our  jobs  use  two  men. 

If  we  R&R  it,  it  is  an  hour  and  a  half  and  two  and  a 
half.  It's  a  bear  to  get  out. 

Okay. 

The  74BDO.  That's  an  R&R.  Say  one  and  a  half  and  two. 
Okay.  Let  me  know  if  there  are  any  jobs  that  don't  fit 
this  pattern,  if  7-levels  would  be  faster  or  different 
troubleshoot  times  or  access  times. 

Most  of  our  jobs  are  R&R.  Some  are  repair  on  ths  air¬ 
craft.  Whenever  we  have  to  troubleshoot,  it  takes  the 
3-levels  longer.  Probably  half  again  as  long  for  any 
of  our  jobs.  Access  and  hook  up  of  AGE  (Aerospace 
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Ground  Equipment  -  power  supplies,  lighting,  aircarts, 
etc.)  don't  take  any  longer. 

H  How  about  inapection  or  verification  tasks? 

W  That  takes  a  3-level  twice  as  long,  when  he  can  do  it, 
once  he's  checked  out. 

H  Okay.  Does  the  troubleshoot  and  inspection  time 

increase  hold  for  all  jobs  or  are  there  some  exceptions? 

W  Well,  let's  see  (looking  at  work  unit  code  manual). 

No,  that's  true  for  all  our  jobs.  Now  maybe  electrics 
might  have  different  times.  Their  jobs  are  more  com¬ 
plicated. 

H  Okay.  I'll  use  50%  time  increase  for  3-level  trouble¬ 
shoot  and  100%  time  increase  for  verify.  What  job. is 
next? 

W  The  74BEO.  Say  one  and  a  half  and  two  hours.  It's 
R&R. 

Okay. 

74BFO.  For  R&R,  say  two  hours  and  three  hours  and  for 
on  aircraft  two  and  a  quarter  and  three  hours.' 

H  Okay, 

W  74BGO.  R&R,  one  and  a  half  and  two  hours. 

H  Okay, 

W  74BHO.  Two  and  a  half  for  5-levels  and  three  and  a 
half  for  3-levels  if  it's  on  aircraft,  and  two  hours 
and  three  hours  if  it's  R&R. 


APPENDIX  C 


5-Level  and  3-Level  Task  Times 

This  appendix  contains  the  list  of  all  tasks  and  task 
times  for  which  5-level  and  3-level  maintenance  personnel 
are  reported  to  have  different  task  times.  The  task  names 
come  from  the  Work  Unit  Code  Manual  as  described  on  page  34. 
The  task  times  were  developed  through  the  operational  audit 
technique  as  described  on  pages  24  through  27  and  Appendix 
B. 

For  each  work  center  included  in  this  study  an  attempt 
was  made  to  interview  at  least  nne  7-level  specialist  and  one 
5-level  specialist.  When  available  a  3-level  specialist  was 
also  interviewed.  Generally  5  and  7  level  personnel  were 
able  to  give  estimates  about  all  the  tasks  that  are  performed 
by  their  work  center.  The  3-level  personnel  could  only  give 
times  for  the  limited  number  of  tasks  that  they  has  experi¬ 
enced.  Whenever  possible  interviews  were  conducted 
independently.  Otherwise,  one  specialist  would  give  an 
estimated  time  (to  the  analyst  this  often  appears  to  be 
the  specialist  with  the  most  experience  in  the  particular  task) 
and  the  other  would  agree  or  disagree.  Without  exception  all 
the  interviewees  gave  the  same  task  time  for  5  and  7  level 
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3-levels  often  differed  from  the  estimates  for  5  and  7  levels. 
When  a  3-levei  was  present,  the  5  and  7  level  SDicialiat 
would  often  ask  his/her  opinion  about  particular  jobs  prior 
to  estimating  3-level  task  times.  In  these  cases  the  task 
times  were  considered  a  consensus  opinion.  Where  interviews 
were  conducted  separately,  the  estimates  were  studied  by  the 
analyst  and  large  differences  settled  by  a  consensus  among 
the  specialists  after  interviews  were  completed.  In  this 
particular  study,  no  differences  of  greater  than  10  percent 
were  noted. 

In  this  analysis  78  of  the  2094  tasks  were  answered  by 
3-level  specialist  independent  of  5  or  7  levels.  The  3- 
level  specialists  were  asked  to  estimate  only  3-level  tasks 
times.  Only  three  of  the  estimated  tasks  times  differed 
from  the  5-level  specialist's  estimates  of  the  3-level  tasks 
times,  and  then  by  only  a  quarter  hour  for  each  three  hour 
task.  Figure  C-l  presents  the  summary  of  3  level/5  level 
task  time  differences.  Figure  C-l  is  then  followed  by  a 
listing  of  task  times  for  5  level  and  3  level  specialists. 
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TASK 

bLVl. 

jl.VL 

TASK 

5LVU 

3LVL 

NAME 

TiMt 

TitoL 

NAM t 

TIMS 

TIME 

A1UAA 

03.1 

0*..? 

A12360 

03.0 

04.5 

All 1A1 

02.9 

04.4 

A12361 

01.0 

01.5 

AlllbX 

01.5 

02.3 

A 12362 

00.6 

01.2 

A111B1 

01.5 

02,3 

A12370 

03,1 

04.6 

AIIIBj 

05.0 

07.5 

A13100 

02.5 

03.7 

AT  1 1CX 

03.7 

05.6 

A13210 

01.7 

02.6 

ah  ic* 

00.5 

0G.6 

A1 32 11 

01.0 

01.5 

Ainux 

01.6 

02,  *1 

A13212 

02.0 

03.0 

A111FX 

01.5 

02,3 

A13213 

02.0 

03.0 

A111F1 

01.5 

02,3 

A 13220 

01.0 

01.5 

a  i  n  f<? 

03.*) 

05.1 

A13221 

00.8 

01.2 

All 1F3 

00,5 

00, a 

A 13222 

04.4 

06.6 

All  1 G  X 

00.7 

01.1 

A13230 

03.4 

05.1 

All  1G1 

06.0 

09,0 

A13231 

04.0 

06.0 

All  IG* 

00,6 

00.9 

A 1 3260 

03.5 

05.3 

All  1  riX 

05.2 

07.6 

A13290 

01.3 

02.0 

A1 1  U!1 

00.  4 

00.6 

A13310 

03.0 

04.5 

A 1  1  1KX 

00.5 

00.0 

A13311 

02.5 

03.8 

A  1 1  IK  1 

01.0 

01.5 

A13312 

03.0 

04.5 

All 1K2 

02.5 

03.8 

A13320 

03.0 

09.5 

A  1 11  LX 

01.  a 

02.7 

A13321 

00.8 

01.2 

All 1XX 

06.0 

09.0 

A13322 

04  .9 

07.4 

A  1 1 1  y  X 

02,0 

03.0 

A1331)  1 

G„. 

00.8 

All  W. 

01.0 

01.5 

A133*)2 

04,tt 

0/.2 

A 1  12Xa 

01,5 

02.3 

A133*)3 

01.7 

02.6 

A112X1 

02  .u 

03.0 

Ai3*no 

06.5 

09.8 

A  112X2 

00.9 

01  ,4 

A13**20 

02.2 

03.3 

A 1 12X3 

01.7 

02.6 

A13*)21 

01.5 

02.3 

A112X** 

Ob.  0 

01 .2 

A13441 

00.5 

00.8 

A  1 1 3XX 

02.0 

03.0 

A13442 

02.0 

03.0 

A 1 1 3  X 

01.3 

02.0 

A13443 

05.1 

07.7 

A  1 1  3Xc 

00.9 

01,1) 

A13444 

00.1 

00.2 

A 1  13X3 

02.7 

0*).l 

A13500 

04.6. 

07.2 

A  12 1 10 

02.5 

08.8 

A13501 

05.0 

07.5 

A 12 1 20 

02.2 

03.3 

A13502 

01.9 

03.0 

A  12201 

02.6 

0)1 .2 

A13503 

02.1 

03.2 

A  1220.' 

00.9 

01  .4 

A1 3504 

02.4 

03.6 

A1220 j 

0  1 ,0 

01  .5 

A 1 6 100 

03.0 

04.5 

A1231C 

03.9 

05.9 

A14101 

07.6 

11.3 

A12330 

02,)* 

011  .8 

A 14 102 

01 .4 

02.6 

A  123b  1 

02.0 

u  j.O 

A14210 

05.9 

08.9 

A  12  3^2 

00.9 

0  1  .)| 

A 1 4220 

03.1 

04.7 

A  12333 

01.1 

01.7 

A14221 

00.5 

00.8 

A  1 2  3  •’*  0 

03.0 

0*1  ,‘j 

A14230 

02.0 

03.0 

A  1233C 

09.1 

0^,6 

A14231 

01.6 

02.7 

14331 

1433 

1433; 

144 1( 
1442C 
14421 
14430 
14510 
14540 
14550 
4500 

4600 

4601 
4  CG? 
4fi0u 
4601 
3100 
3200 


02.1 

03.2 

02.0 

03.0 

03.0 

04.5 

00.8 

01.2 

02.5 

03. d 

02.1 

03.2 

05.9 

06.  y 

02.1 

03.2 

02.3 

03.5 

06.0 

09.0 

04.0 

00.0 

02.0 

01 .0 

03.9 

04.0 

01.2 

01.6 

02.4 

03.6 

00.5 

00.6 

04.3 

06.5 

03.3 

05.0 

03.0 

04.5 

' 

*  »  w 

01.1 

!•;  n 

03.0 

0J.> 

05.1 

02.0 

03.0 

00. y 

01.4 

21.0 

3'.5 

09.1 

1  J.7 

02.4 

03.6 

12.0 

lo. 0 

00.7 

01.1 

06.5 

09.8 

01.9 

02.9 

00.5 

00.8 

02.y 

04.5 

30.9 

01 .4 

32.4 

0  j.6 

36.2 

09.3 

31.2 

01  ,u 

)0,9 

01.4 

>1.6 

02.4 

1.0 

01,5 

2,0 

03. 0 

2,2 

03.3 

1.9 

02.9 

2.8 

04.2 

1.-7 

02.6 

i 
A 
A 
A 
A 
A 
A 
A 
A 
A 
A 
A 
A1 
A< 

A< 

A1 
A* 

A* 

A4 
A4 
A4 
A4 
A4 
A4 
A4 
A4 
A4 
A4i 
A4 
A4I 
A47100 
A51  1*0 
A51 1AJ 
A51  1AL 
A51 1 A 1 
A5 12*0 
A512AB 
A51 

A513H0 
A521C0 
A522*0 
A522B0 
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TASK 

5UVL 

3LVL 

TASK 

5LVL 

3LVL 

NAMt 

TlMfc 

TIMS 

NAMt 

TIM* 

TIME 

A522EO 

02.0 

03.0 

A74BCQ 

04.0 

06.0 

A? IB  10 

06.0 

09.0 

A74BC0 

01.3 

02.0 

A7 1 B2u 

06.0 

09.0 

A74&D0 

06.0 

09.0 

A71H10 

02.0 

00.6 

A74BF0 

04.0 

06.0 

A71H20 

01,3 

02,0 

A74BCQ 

04.0 

06.0 

A71h21 

02.5 

03.8 

A74BH0 

04.0 

06.0 

A71Hbw 

06.0 

09.0 

A74BJ0 

03.0 

04.5 

A71H60 

06.0 

09.0 

A74BL0 

03.0 

04.5 

A71L*0 

06.0 

09.0 

A74BM0 

02.0 

03.0 

A71L»1 

01.0 

01.5 

A74BN0 

05.0 

07.5 

A7 1  LbO 

04.2 

Oo  .3 

A74BB0 

06.0 

09.0 

A71LC0 

05.0 

07.5 

A74BQ0 

04.0 

06.0 

A71LC1 

02.3 

03.5 

A74BR0 

01.0 

01.5 

A71LC2 

00.6 

01.2 

A74BS0 

03.0 

04.5 

A/1LD0 

02.0 

03.0 

A74BU0 

03.2 

04.8 

A71LE0 

06.0 

12.0 

A74BVO 

06.0 

09.0 

A71LQ- 

00.4 

00.6 

A74C»0 

03.0 

04.5 

A71LX0 

04.0 

06.0 

A74CA0 

03.2 

04.8 

A71M»0 

01.2 

01 .8 

A74CB0 

02.2 

03.3 

a7im«i 

00.8 

01 .2 

A74CB1 

02.1 

03.2 

A71MA0 

04.5 

06.9 

A74CC0 

03.8 

05.2 

A71MEJ 

04.0 

06.0 

A74D*0 

01.3 

02.0 

A71KG0 

01 .5 

Oc.3 

A74DAC 

03.5 

05.3 

A7  IMIiG 

05.0 

07.5 

A74DB0 

04.0 

Ob  .0 

A7 ISOj 

02.1 

03.2 

A74DC0 

03.7 

05.9 

hi  i  iuu 

01,2 

01  .6 

A74BOO 

01.0 

01.5 

A71U0O 

02.8 

04.2 

A74EOI 

00.5 

00.8 

A723AC 

04.0 

06.0 

A7430i: 

03.0 

04.5 

A723BG 

02.0 

03.0 

A746» 

00.7 

01.1 

A723B1 

03 .4 

05.7 

A74810 

00.8 

01.2 

A72500 

00.8 

01.2 

A74820 

02.0 

03.0 

A731BO 

03.1 

v-4.7 

A74830 

04.2 

06,3 

A731CO 

04,0 

06.0 

A74840 

02.0 

03.0 

A73 1  L>0 

02.3 

03.5 

A74841 

00.7 

01.1 

A731EO 

03.0 

04.5 

A75BOO 

02.2 

03.3 

A73UO 

01.5 

02.3 

A75B01 

01 .0 

03.0 

A731HO 

02 . 4 

03.6 

A76E*A 

01.5 

02.3 

A735*0 

00.8 

01,2 

A76ti*2 

03.0 

04.5 

A  7  35 1 1  * 

02.  C 

03.0 

A76EA0 

05.8 

08.7 

A735<-.' 

04,0 

06.0 

A76EEO 

03.0 

04.5 

A  7  35  7-0 

06,0 

0^.0 

A76LCO 

01,5 

02.3 

A735  ]  i 

00.1 

00.2 

A766D0 

02.3 

03.5 

A74U»0 

01 . 1 

0  1.7 

A7  uKAO 

03.2 

04.8 

A74DAG 

02.0 

03.0 

A77J*0 

02.5 

03.8 

A74BUG 

03,0 

04.6 

A77J2A 

03.0 

04.5 
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TAijK 

5LVL 

3LVL 

TASK 

5LVL 

3LVL 

NAME 

TIME 

TIME 

NAME 

TIME 

TIME 

B4710G 

00.5 

00.6 

B731HO 

01.0 

01.5 

b511*0 

01.0 

01.5 

B731MO 

01.0 

01.5 

B51 1Ab 

01.0 

01.5 

B731NO 

00.5 

00.8 

D511AD 

01.0 

01.5 

B732A0 

01.5 

02.3 

B511AJ 

01.0 

01.5 

b?35*0 

00.8 

01.2 

B511AL 

01 .0 

01.5 

B73510 

01.0 

01.5 

B5 12*U 

01.0 

01.5 

B73520 

02.0 

03.0 

B512Ah 

01,0 

01.5 

B73530 

04.0 

06.0 

B512CL 

01,0 

01.5 

B74B*0 

01.0 

01.5 

B5i3*c 

01 .0 

01.5 

B74BA0 

01.0 

01.5 

B5 1 3BG 

01.0 

01.5 

B74BBO 

01,0 

01.5 

B513B0 

01 .0 

01.5 

B74BC0 

01.4 

02.1 

B513HO 

02.0 

03.0 

87 4 BDO 

01.5 

02.3 

B513XO 

02,3 

00.4 

B74BFO 

01.0 

01.5 

B522"0 

01.0 

01.5 

B74BG0 

01.5 

02.3 

B522B0 

01.0 

01.5 

B74BHO 

01.5 

02.3 

B522E0 

01.7 

02,6 

B74BJO 

01.0 

01.5 

B71B10 

02.1 

03.2 

B74BLO 

01.0 

01.5 

B71B10 

01,0 

01.5 

B74BMO 

00.8 

01.2 

B71B20 

02.8 

03.0 

B74BN0 

01.0 

01.5 

B71H10 

01,0 

01.5 

B74BB0 

02,0 

03.0 

B71H2u 

02.0 

03.0 

B74BU0 

01.0 

01.5 

B71K5G 

04.0 

06.0 

B74BSO 

01.0 

01.5 

B71H6G 

02.0 

03.0 

B74BU0 

00.6 

01.2 

B7 1 LOG 

00,5 

CO. 8 

B74BVO 

01.7 

02.6 

B71LC0 

00.5 

GO. 8 

374CB0 

01.5 

02.3 

B71LDU 

00,5 

00,6 

374 D AO 

01.6 

02.4 

B71LE0 

04.0 

06,0 

B74DB0 

02.1 

03.2 

87 1ME0 

02.0 

03.0 

B74DCO 

01.6 

02.4 

B71MGO 

00.5 

00,6 

B74EOO 

00.8 

01.2 

B71MHG 

03.0 

04.5 

B74300 

01.0 

01.5 

B7UIAO 

02.0 

03.0 

B74810 

01.5 

02.3 

B71SOO 

01,3 

02,0 

874820 

01. o 

01.5 

B71TOG 

01  .3 

02.0 

B74830 

01.2 

01.8 

B71UOG 

01,6 

02,4 

B7484C 

01.5 

02.3 

B723AG 

00,5 

00.0 

B75B00 

00.9 

01.4 

B723BG 

00,5 

b0.8 

B76E*2 

01.2 

01,8 

B7250G 

00,5 

00.6 

B76EA0 

02.0 

03.0 

B731*0 

01 .0 

01.5 

076 EDO 

01.0 

01.5 

873160 

01  ,5 

02.3 

B76EC0 

00.6 

00.9 

B731CO 

01,5 

02,3 

B76EOO 

00.6 

01.2 

BY 31  GO 

02.2 

03.6 

B76FA0 

01.0 

01 .5 

B7  3 1  BO 

01.0 

01.5 

B77J2A 

01.0 

01.5 

B73UO 

01  .0 

01.5 

B77J2K 

01,0 

01.5 

B73VJL 

01  .-5 

U2.3 

B77X*0 

01.0 

01.5 
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TASK 

5LVL 

3LVL 

NAME 

TIME 

time 

task 

5LVL 

3LVL 

NAME 

TIME 

time 

H4610A 

02.3 

04  6 

H46100 

01.6 

03.2 

H74D00 

00.6 

01.2 

H46110 

04.0 

08.0 

H74800 

00.7 

01.4 

H46130 

01.7 

03.4 

H75B00 

01.0 

02.0 

H4614B 

01.5 

03  0 

H75B01 

01.0 

02.0 

H46140 

02.6 

05.2 

H75E0O 

01.3 

02.6 

H4615A 

02.0 

04,0 

H76E00 

01 .8 

03.6 

H46150 

01.8 

03  6 

H76F00 

00.7 

01.4 

H46160 

00.5 

w  J  »w 

01  0 

H77X00 

01.0 

02.0 

H462»0 

03.0 

06,0 

H77500 

01.2 

02.4 

H46210 

02.7 

06.4 

IAAB00 

04.0 

08.0 

H46230 

02.0 

04 .0 

JCKGUN 

00,4 

00.6 

H4630X 

02.0 

04 .0 

J CODES 

00.7 

01.1 

H46300 

01.5 

03.0 

JCOftIN 

00,5 

00.8 

H46301 

01.0 

02.0 

JCOfift 

02.5 

03.8 

H46302 

04.0 

08.0 

JECMCK 

00.2 

00.3 

H464*C 

01.5 

03.0 

JENGS1 

00.6 

00.9 

H464*1 

01 .5 

03  0 

JENGS2 

00.3 

00.5 

H464*2 

04.3 

v  J  tW 

06  6 

JETCKO 

00.3 

00.5 

H46420 

02.0 

04.0 

JETCK1 

00.3 

00.5 

H47100 

00.5 

01.0 

JE0RG1 

00.1 

00.2 

H47101 

00.8 

01  6 

JEORIN 

00.1 

00.2 

H47200 

01.5 

03  0 

JLUBE 

00.7 

01.1 

H47201 

00.8 

01  6 

JLOXSV 

00.7 

01.1 

H49100 

02.0 

04  .0 

JPKCK1 

00.2 

00.3 

H51 100 

01.5 

05.0 

JPOST2 

02.0 

03.0 

H51200 

02.0 

04.0 

JPREP1 

01.0 

01.5 

H51300 

02.0 

04  .0 

JPRFLO 

01.2 

01.8 

H52100 

02.0 

04.0 

JPRFL1 

01.2 

01.8 

H52200 

02.0 

04  .0 

JPRLCO 

00.6 

00.9 

H55100 

00.5 

01 ,0 

JP0ST1 

02.0 

03.0 

H71B00 

01.8 

qv  6 

JTAXIO 

00.2 

00.3 

H71H00 

02.5 

05  .0 

JTAXOM 

00.2 

00.3 

H71L00 

00.9 

0 1  8 

JTHHUF 

01.0 

01.5 

H71L01 

01.0 

V  1 

02  0 

JTOWAC 

00.4 

00.6 

H71M01 

02.0 

vt  *V 

04  .0 

JTOWBK 

00.5 

00.8 

H71N00 

01,0 

02  0 

MAAAOO 

01.5 

02.8 

H71U00 

00.7 

01 .4 

MAAA01 

02.4 

03.6 

H72300 

01.0 

02.0 

MAABOO 

01.3 

02.0 

H72500 

00,7 

01 .4 

MAACOO 

02.2 

03.3 

H73 100 

01.5 

0  3  0 

MAAEOO 

02.9 

04.4 

H73200 

01.0 

.j.y 

02  n 

MAC2A0 

01.2 

01.8 

H73500 

03.0 

06.0 

MAC2B0 

02.0 

03.0 

H74BOO 

00.7 

01  4 

MAC2C0 

01.0 

01,5 

H74CGO 

01.2 

02  4 

MAC2E0 

04.0 

06.0 

MAC2E1 

01.6 

02.7 
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TASK 

5LVL 

3I-VL 

TASK 

5L«L 

3LVL 

NAME 

TIME 

1 1  ME 

NAME 

TIME 

TIME 

MAC2FC 

00.0 

01.2 

Ml 120X 

09.5 

14.3 

MAC2G2 

00.7 

01.1 

Ml  1201 

01.1 

00.3 

MD6000 

00.5 

00.8 

Ml  1202 

01.1 

01.7 

MNF200 

00.5 

00.6 

Ml  1203 

04.0 

06.0 

MSLIS1 

00.1 

00.2 

Ml  1204 

09.5 

14.3 

MTTUOO 

00.5 

00.8 

Ml  1300 

01.0 

01.5 

Mil 1AO 

00.8 

01 .2 

Ml  1301 

02.0 

03.0 

Mil  1  AT 

00.8 

01.2 

Ml  1302 

01.4 

02.1 

Ml  1 1A2 

01 ,4 

02.1 

Ml  1303 

01.1 

01.7 

Mil  180 

00.5 

00.8 

Ml  1304 

05.0 

07.5 

Ml libl 

01.0 

01.5 

Ml  1305 

01.0 

01.5 

Ml  1182 

02.0 

03.0 

M11306 

00.5 

00.8 

Ml  1183 

02.7 

04,1 

M1211X 

03.0 

04.5 

Ml  1 1CO 

00.5 

00.8 

M12110 

01.0 

01 .5 

Mil  1C  1 

01.0 

01 .5 

M12111 

01.1 

01 .7 

M111C2 

01.5 

02.3 

M12112 

01.0 

01.5 

Mil  IDO 

00.5 

00.8 

M12113 

01.0 

01.5 

Mil  1D1 

01 .0 

01 .5 

M12114 

01.0 

01 .5 

M111D2 

oo.-; 

00.8 

M12120 

01.0 

01 .5 

Ml  11D3 

00.9 

01.4 

Ml  2 121 

01.0 

01.5 

M111F0 

01 .0 

00,2 

M12122 

01.0 

01 .5 

Ml  1 1F  1 

00.6 

00,9 

M12123 

01.0 

01 .5 

Ml  1  1 8  2 

01 .0 

01,5 

M12200 

01.0 

01 .5 

Mill  r j 

01.9 

02,9 

M12201 

01 .0 

01.5 

Ml  1 1CO 

01.5 

02.3 

Ml  2202 

01.3 

02.0 

Mil 1G1 

01  .0 

01.5 

M12203 

01.0 

01 .5 

M111G2 

01.5 

02,3 

Ml  2204 

00.5 

00.8 

Mil 1G3 

01.5 

02.3 

M12310 

02.2 

03.3 

Ml  11  HO 

01  .0 

01.5 

M12311 

02.0 

03.0 

M111H1 

01.8 

02,7 

M12312 

01.2 

01 ,8 

Mill  tic 

01 , 1 

01.7 

M12320 

02.0 

03.0 

Ml  1 1H3 

01  .0 

01.5 

M12321 

02.0 

03.0 

Ml  1 1 KO 

01.1 

01.7 

M12322 

03.2 

04.8 

M 1  1  1  (Cl 

01 .6 

02.4 

M12323 

00.8 

01.2 

Ml  1 1K2 

03.0 

04.5 

M12324 

00.5 

00.8 

Ml  1 1K3 

00.7 

01.1 

Ml  2325 

00.6 

CO. 3 

Ml  1 1L0 

00.5 

00,8 

M12326 

00.9 

01.4 

Ml  1 1L1 

01 .0 

01  .5 

M12330 

00.8 

01,2 

M 11 1 L2 

01.0 

01.5 

M12331 

00.5 

00.8 

Mil  no 

O'j.l 

0  4,7 

M12332 

01 .0 

01.5 

Ml  11X1 

01  ,0 

01.5 

M12333 

01 .7 

02.6 

Ml  11X2 

01.1 

01 .7 

M12334 

02,6 

03.9 

Ml  11X3 

02.1 

03.2 

M12335 

01 .0 

01 .5 

Mil  191 

01  .0 

01  .5 

M12340 

01 .5 

02.3 

Ml  1 19c: 

01. -o 

01,5 

M12341 

.  00.5 

00.8 
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TASK 

5LVL 

3I-.VL. 

TASK 

5LVL 

3LVL 

NAME 

TIME 

TIME 

NAME 

TIME 

TIME 

M1343  * 

01 .0 

01  .5 

M14262 

02.0 

ou.o 

M13440 

01.4 

02.1 

M14263 

02.5 

05.0 

M13441 

01.0 

01.5 

M1428X 

01.3 

02.6 

Ml 

01.7 

02.6 

M14280 

02.0 

04.0 

Ml  34^3 

01.7 

02.6 

M14281 

01.3 

02.6 

M13500 

00.5 

00.8 

M14282 

00.5 

01.0 

M13501 

01,7 

02.6 

M1431Q 

00.5 

01.0 

Ml  3502 

01.0 

01.5 

M14311 

00.5 

01.0 

Ml  3503 

01.0 

01.5 

M14312 

01.9 

03.8 

Ml  3504 

00,5 

00.8 

M1432X 

02.0 

04.0 

Ml  3505 

01.6 

02.4 

M14320 

03.0 

06.0 

M14100 

01.5 

03.0 

M14321 

02.5 

05.0 

N141C1 

01.2 

02.4 

M14322 

01.2 

02.4 

M14102 

04.5 

09.0 

M1433X 

05.0 

10.0 

M 1 4  1 0  3 

01.0 

02.0 

M14330 

00.9 

01.8 

M14104 

01  .4 

02.8 

M 1 4  3  3 1 

01.0 

02.0 

M142XX 

01.2 

00.3 

M14332 

05.0 

’0.0 

M142XY 

02.5 

05.0 

M14333 

01.0 

02.0 

M142X0 

01,2 

02.4 

M14334 

01.2 

02.4 

M142X* 

02.5 

05.0 

M14350 

00.7 

00.2 

M14200 

03.5 

07.0 

M1436X 

02. b 

05.6 

M14210 

01.5 

03.0 

M14360 

02.8 

05.6 

Ml  42 1 1 

01.3 

02.6 

M14361 

01.0 

02.0 

M14212 

Ol.o 

03.2 

M14362 

01.5 

03.0 

M1422X 

01.7 

03. 4 

M14363 

02.2 

04.4 

Ml  4220 

02.5 

05.0 

M14400 

00.3 

00.6 

M1422 1 

00.  a 

01 ,6 

M14401 

OO.b 

01.2 

M 14222 

04.3 

08.6 

M14410 

02.5 

05.0 

M14223 

01.0 

02.0 

M1441 1 

01.0 

02.0 

Ml  4224 

00,3 

00,6 

M14412 

00.8 

01.6 

M14231 

02.7 

05.4 

Ml  4  h  1 3 

04.3 

00.6 

M 1 4  2  32 

02.2 

04.4 

M1442X 

03.1 

06.1 

Ml  423  3 

01.1 

02.2 

M14420 

02.0. 

04.0 

M14234 

00.8 

01.6 

M14421 

01.9 

03.8 

M14240 

01.0 

02,0 

Ml  4 422 

05.0 

10.0 

M1424  1 

00.8 

01 .6 

M14423 

01.0 

02.0 

M1424*' 

01,1 

02.2 

M1443X 

01.5 

03.0 

M1424  i 

02.6 

05.6 

M1443Y 

01.9 

03.8 

M1425X 

02.3 

04.0 

M14430 

01.5 

03.0 

Ml  4200 

01.5 

03.0 

M14431 

01.0 

02.0 

M14251 

02.5 

05. 0 

M14432 

03.0 

06.0 

M14252 

01.2 

04  .8 

M14433 

01.9 

03.8 

M1426X 

02.0 

04.0 

M14500 

01.9 

03.8 

M14260 

02.0 

04  .0 

M14501 

01.1 

02.2 

M14261 

01.6 

03.2 

M14510 

01,1 

02.2 
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TASK 

‘3LVL 

30VL 

TASK 

5LVL 

3LVL 

NAME 

TIME 

TIME 

NAME 

TIMS 

TIME 

M461  '.A 

02.0 

03.0 

M46421 

01.2 

01.8 

M4611B 

01.0 

01.5 

M46422 

00.5 

00.8 

M46 1 10 

01.5 

02.3 

M47100 

00,5 

00.8 

M4612A 

00.9 

01.4 

M47200 

01.2 

01.8 

M4612B 

00.7 

01.1 

M47201 

00.9 

01.4 

M46120 

01.5 

02.3 

M47202 

00.5 

00.8 

M4613A 

01.5 

02.3 

M49100 

01.0 

01.5 

M4613E 

00.9 

01.4 

M49101 

01.0 

01.5 

M4613C 

01.0 

01.5 

M49102 

00.5 

00.8 

M4613Z 

02.0 

03.0 

M491Q3 

01.4 

02.1 

M46130 

01.0 

01.5 

H5 1 1 *  1 

01,3 

02.0 

M4614A 

02.0 

03.0 

M51 1AB 

01,0 

01.5 

M4614B 

02.5 

03.8 

M51 1AD 

01.0 

01.5 

M46140 

01,0 

01.5 

M511AJ 

01.1 

01.7 

M4615A 

01.0 

01,5 

M51 1AL 

01.0 

01.5 

M4615B 

00.9 

01 .4 

M511A1 

01.1 

01.7 

M46150 

01.0 

01.5 

M5HCA 

01.0 

01.5 

M4616A 

00.5 

00.8 

M511C1 

01.0 

01.5 

M4616B 

01.0 

01.5 

M512»0 

00.5 

00.8 

M4616C 

03.9 

05.9 

M512*1 

01.0 

01 .5 

M46100 

01.0 

01,5 

M512AA 

00.8 

01.2 

M4  6 1  9B 

01 .0 

01.5 

M512AB 

02.6 

03.8 

M46199 

01.8 

02.7 

M512A1 

01.0 

01 .5 

M462«0 

01.0 

01,5 

M512A2 

01.0 

01.5 

M46jf*  1 

0C.1 

13.7 

M512A3 

01.0 

01.5 

M462«2 

01.0 

01,5 

M512A4 

01.2 

01.8 

M462*3 

01.4 

02,1 

M512CL 

00.5 

00.8 

M4621B 

01.0 

01.5 

M512C1 

01.2 

01.8 

M46210 

01.0 

01.5 

M512C2 

01.0 

01.5 

M46220 

00.7 

01.1 

M513*0 

00.9 

01.4 

M46221 

02.9 

04,4 

M513BO 

00.5 

00.8 

M4623A 

02.0 

03.0 

M513B1 

00.6 

00.9 

M4623B 

00.5 

00.8 

M513EO 

00,6 

00.8 

M4623C 

01,1 

01,7 

M513F0 

00.5 

00.8 

M4623U 

01.0 

01 .5 

M513F1 

01.5 

02.3 

M46230 

01,5 

02.3 

M513HO 

01.9 

02.9 

M46300 

00.5 

00. 0 

M513X0 

01.0 

01.5 

M46301 

01.5 

02,3 

M51300 

02.0 

03.0 

M46302 

02.0 

0J. 0 

M52100 

02.0 

03.0 

M46303 

02.8 

04.2 

M522B0 

01,0 

01.5 

M464*Q 

03.9 

05.9 

M522E0 

02.0 

03.0 

M464»1 

01,0 

01.5 

M52200 

02,0 

03.0 

M464<*2 

01.5 

02.3 

M55100 

01.5 

02.3 

M464«3 

00,6 

00.9 

M71BL0 

00.5 

00.8 

M46420 

01. -b 

02.4 

M7 1b00 

01.6 

02.4 

TASK  5LVL  JLVL 
NAMS  TIMS  TIMS 

M7182C  01,5  02.3 
M71H00  03.0  04,5 
M71H10  01.0  01.5 
M71H20  02.0  03.0 
M71H50  03.0  04.5 
M71H60  02.5  07.8 


M71H61 

00.9 

01.4 

M71L»0 

00.5 

00.8 

M7 1 L* 1 

00.5 

00.8 

M71L*2 

02.0 

03.0 

M71LC0 

00.5 

00.8 

M71LD0 

00-5 

00.8 

M71LD1 

02.0 

03.0 

M71LS0 

01.5 

02.3 

M71LQO 

03.5 

05.3 

M71LSO 

01.0 

01.5 

M71LX0 

01.5 

02.3 

M71L00 

02.8 

04.2 

M71L20 

02.0 

03.0 

M71L50 

00.5 

00.8 

M71L70 

00.5 

00.8 

H71L71 

00.5 

00.8 

M7 1 Mfc0 

01.0 

01.5 

M71M*1 

01.6 

02.4 

M71MS0 

01.0 

01,5 

M71MB1 

01,0 

01.5 

M71MG0 

00.7 

01,1 

M71MH0 

02.0 

03.0 

M71NA0 

00.9 

01.4 

M71N00 

01.0 

01.5 

M71R00 

01.2 

01.8 

M71S00 

01.2 

01.8 

M71T00 

00. 8 

01,2 

M71U00 

00.6 

00.9 

M723*0 

01,0 

01.5 

M723*l 

01.8 

02.7 

M723A0 

01. U 

01.5 

M723A1 

01.8 

02.7 

M723B0 

00.5 

00,8 

M723B1 

00.6 

00.9 

M72300 

01.0 

01.5 

M72500 

01.5 

02.3 

M72501 

00.9 

01,4 

M73 1 *0 

00.5 

01.0 

M731BO 

00 

00,8 

148 


TASK 

5LVL 

3LVL 

NAME 

TIME 

TIMS 

M731CO 

01.1 

02.2 

M731D0 

02.4 

04.8 

M731D1 

00.9 

01.8 

M731E0 

02.6 

05.6 

M731F0 

01.5 

03.0 

M731G0 

00.9 

01.8 

M731H0 

00.5 

01.0 

M731H1 

00.9 

01.6 

M731H2 

00.2 

00.4 

M731M1 

01.3 

02.6 

M731NO 

00.6 

01.2 

M731N0 

00.5 

01.0 

M73100 

00.5 

01.0 

M732A0  , 

00.5 

01.0 

M732A1 

02.4 

04.8 

M732B0 

01.0 

02.0 

M732CO 

00.6 

01.2 

M735«0 

00.5 

01.0 

M73500 

01.1 

02.2 

M73510 

01.0 

02.0 

M73520 

02.0 

04,0 

M7353Q 

03.0 

06.4 

M748fc0 

01.1 

0  2.2 

M74BA0 

01.0 

02.0 

M74B80 

01.0 

02.0 

M74BC0 

01,0 

02.0 

M74BDO 

01.0 

02.0 

M74BF0 

02.0 

04.0 

M74BGO 

01.0 

02.0 

M74BH0 

01.0 

02.0 

M74BJ0 

01.0 

02,0 

M74BLO 

01.0 

02.0 

M7  4  BMO 

00.5 

01.0 

M74BN0 

01.0 

02.0 

M74BP0 

02.0 

04.0 

M74BQO 

01.0 

02.0 

M74BR0 

01.5 

03.0 

M74BS0 

01.0 

02.0 

M74BUO 

01 .0 

02.0 

M74BV0 

01.5 

03.0 

M74B00 

02.4 

04.8 

M74B01 

01.3 

02,6 

M74C»0 

00.7 

01.7 

M74CAO 

01.4 

02.8 

M74CBQ 

00.5 

01.0 
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TASK 

5LVL 

3LVL 

TASK 

5LVL 

3UVL 

NAME 

TIME 

TIME 

NAME 

TIME 

TIME 

M74CC0 

01. a 

03.6 

M76C00 

02.0 

04.0 

M74DaG 

00.7 

01.4 

M77J*1 

00.5 

01.0 

M740a1 

01.8 

03.6 

M77J2A 

01.2 

02.4 

M74D*>2 

01.8 

03,6 

M77J2K 

00,9 

01.8 

M74DAO 

00.5 

01.0 

M77J21 

00.5 

01.0 

M74DBO 

01.3 

02.6 

M77X*0 

01.1 

02.2 

M74DCO 

00. 4 

00.8 

M77X6D 

00.5 

01.0 

M74D0G 

00.7 

01.4 

M97900 

00.6 

01.2 

M74E00 

00.*t 

00.8 

PABKO 

01.5 

02.3 

M7^E01 

01,0 

02.0 

PABftl 

06.5 

09.8 

M74300 

00.5 

01.0 

PAUTO 

02.0 

03.0 

M748aG 

01.2 

02.4 

PCOMQ 

02.0 

03.0 

M7460G 

00.6 

01.2 

PCOROO 

03.7 

05.6 

M74B10 

00.9 

01.8 

PC0R01 

03.6 

05.4 

M74820 

01.5 

03.0 

PC0R02 

00.44 

00.6 

M7483u 

01.0 

02.0 

PC0R03 

00.5 

00.8 

M74840 

01.0 

02.0 

PCOR04 

01.0 

01.5 

H75BOO 

01.2 

02.4 

PC0R05 

00.3 

00.5 

H75BG1 

00.3 

00.6 

PC0R06 

00.8 

01.2 

M75B02 

00.3 

00.6 

PCQR07 

00.1 

00.2 

M75b  j  3 

00,6 

01.2 

PC0R08 

01.4 

02.1 

MY  5  BO*: 

00.5 

01.0 

PC0RQ9 

02.1 

03.2 

M75B05 

01.1 

02,2 

POOR 10 

02.3 

03.5 

M75EUG 

02.3 

04.6 

PC0R11 

11.0 

16.5 

M75EU  ! 

01.  o 

03,2 

PC0R12 

12.0 

18.0 

M7  5 1 CQ 

00.5 

01,0 

PC0R13 

00.2 

00.3 

M7  5 1 G 1 

00.8 

01,6 

PDEPAN 

02.0 

03.0 

M751C2 

01.3 

02.6 

POFULU 

01.0 

01.5 

M751C3 

01.0 

02.0 

PDOPO 

01.0 

01.5 

M751DO 

00.8 

01.6 

PECMO 

00.5 

00.8 

M7510 1 

03.it 

06.8 

PECSO 

01.0 

01.5 

M75600 

00.7 

01,4 

PECRSO 

06,0 

09.0 

M7580G 

00.9 

01,8 

PELECO 

01.0 

01.5 

M75900 

02.0 

04,0 

PELEC1 

03.0 

04.5 

M76E*1 

01.1 

02,2 

PEN01 

06.0 

09.0 

M76E*2 

01. 3 

02.6 

PENG2 

10.0 

15.0 

M76E*j 

01 ,0 

02,0 

PFUELO 

01.0 

01.5 

M76EAO 

01.8 

03.6 

PHHP06 

33.0 

49.5 

M76EBU 

02.0 

04.0 

PHP01 

06.0 

09.0 

M7  6  ECO 

01.3 

02,6 

PHP03 

16.5 

24.8 

M76EDO 

00,9 

01.8 

PHY  00 

02.5 

03.8 

M76EOO 

02,5 

05.0 

PHYD1 

06.0 

09.0 

M76F*0 

01.3 

02.6 

PINSQ 

01.0 

01.5 

M76FAu 

01.5 

03.0 

PI  MSI 

02.0 

03.0 

M76FOU 

01.3 

0  j  ,  j 

PJACK 

01.0 

01.5 

,»I»R 


R4I300 
R4i4oo 
R4210X 
R421CO 
R42101 
R42io? 
R42103 
R42104 
R42105 
K42106 
R4220X 
R42201 
R4220O 
R4230U 
R42301 
R42600 
R42601 
IOC 
R44101 
R4420  I 
R44220 
R45 10X 
R45100 
R45101 
R45200 


03 
03 
04 
06 
02 
03 
03 
04 
03 
04 
03 
03 

04. ^ 
06.0 
06.0 
06.0 
05. 
02. 
03. 
06. 
01 . 
00. 
01. 
or 
02. 
02. 
ot>. 
03,1 


R5 12*0 


R513X0 

R52100 


01  01.0 

01.5 

10  04.2 

06.3 

20  09.2 

13.6 

30  05.5 

08.3 

'•A  02.0 

03.0 

**0  03.5 

05.3 

50  06.2 

09.3 

&A  01.6 

02.4 

50  07.9 

11.8 

JA  03.0 

04.5 

>9  03.0 

04.5 

*0  02.0 

03.0 

0  02.5 

03.8 

►0  09.0 

13.5 

IB  01.7 

02.6 

0  02.0 

03.0 

0  03.5 

05.3 

2  01.8 

02,7 

0  01.1 

01.7 

1  01.4 

02.1 

2  04.0 

06.0 

0  01.8 

02.7 

1  03.0 

04.5 

0  00.5 

00.9 

1  00.9 

01.4 

0  01.4 

02.1 

1  00.9 

01.4 

3  02.0 

03.0 

)  01  .f 

02.3 

3  01.3 

02.0 

>  01.3 

02.0 

Ol.j 

02.0 

01 .5 

02.3 

01.5 

02.3 

01 .2 

01.8 

00.9 

01 .4 

01.0 

01.5 

01.0 

01.5 

01.3 

02.0 

01.5 

02.3 

01 .0 

01.5 

03.0 

04.5 

01 .9 

02.9 

01 .5 

02.3 

01  .0 

01.5 
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5LVL 

31.  VI. 

TASK 

5LVL 

3LVL 

TIME 

TIME 

NAME 

TIMS 

TIME 

01.0 

01.5 

R?6B»1 

01.3 

02.6 

01.0 

01.  'i 

R76E»2 

01.6 

03.2 

01 .0 

01.5 

R76E#i 

01.5 

03.0 

01.5 

02.3 

R76EAO 

03.0 

06.0 

01.2 

01.8 

R76EP0 

03.0 

06.0 

01 .2 

01.8 

R76EC0 

02.0 

09.0 

00.9 

01.9 

R76ED0 

03.0 

06.0 

01.2 

0\8 

R76F*0 

01.5 

03.0 

02.0 

03.0 

R76FAO 

02.1 

09.2 

01.7 

02.0 

R76QOO 

01.5 

03.0 

01.0 

02.0 

R77J*0 

01.5 

02.3 

01.5 

02.0 

R77J2K 

01.9 

02.1 

01.3 

02.0 

R77K2A 

01.7 

02.6 

01.0 

02.0 

R77X»0 

01.8 

02.7 

01.2 

02.9 

R77X6D 

00.7 

01.1 

01.2 

02.0 

R91200 

01.3 

02.0 

02.0 

02.0 

R93200 

01.3 

02.0 

02.0 

02.5 

R97900 

00.7 

01.1 

00.6 

01 .2 

VI 1 1 AO 

00.3 

00.6 

03.0 

03.5 

V23000 

08.0 

16.0 

00.6 

01 .0 

V75600 

00.6 

01.2 

01.9 

01.9 

V76C00 

00.5 

01.0 

01.9 

01.5 

Y2AHY9 

00.2 

00.3 

01  .9 

02.5 

Y2AM75 

00.5 

00.8 

01 

02.0 

Y23M03 

01.3 

07.0 

01.0 

02.0 

Y23M09 

01.2 

02.8 

00.5 

01 .5 

Y23M05 

03.9 

05.9 

01 .8 

03.5 

Y23R00 

12.0 

18.0 

01.9 

02.0 

Y23R01 

36.0 

90.0 

01.8 

03.5 

Y23R02 

02.9 

09.5 

02.6 

03.6 

Y9AM90 

00.1 

00.2 

01.0 

02.0 

Y9AM91 

00.9 

00.6 

01 .0 

02.0 

Y9AH92 

00.6 

00.9 

01.3 

09.0 

Y9AM93 

00.8 

01.2 

01 .9 

02.0 

Y9AM99 

00.1 

00.2 

02.0 

02.5 

Y9AH95 

01.3 

02.0 

03.0 

05.0 

Y9AM96 

01.0 

01.5 

09.8 

05.6 

Y9AM97 

00.1 

00.2 

06.0 

12.0 

Y9AM98 

00.2 

00.3 

01 .0 

02.0 

Y9AM99 

00.3 

00.5 

01.9 

02 . 8 

01.9 

02.8 

01  .0 

03.2 

01.0 

02.0 

02.0 

09.0 

155 

Opinion  Survey  of  Aircraft  Pilots 
Pertaining  to  Maintenance  Skill  Level  Changes 
There  is  some  consideration  being  given  to  reducing 
the  average  aircraft  maintenance  skill  levels  at  opera¬ 
tional  units  from  the  current  average  5  level  to  the  mini¬ 
mum  possible  to  perform  the  tasks  required  in  both  scheduled 
and  unscheduled  maintenance. 

In  an  attempt  to  analyze  the  impact  this  skill  level 
change  may  have  upon  mission  accomplishment,  I  am  interested 
in  your  opinion  as  a  pilot  who  will  be  flying  the  affected 
aircraft  as  to  what  impact  this  skill  level  change  will 
produce.  Therefore  I  have  developed  the  attached  question- 

aire  to  aid  in  expressing  your  opinion.  Please  feel  free 
to  add  any  comments  you  may  have  pertaining  to  the  subject. 

You  need  not  identify  yourself  unless  you  wish.  The 

information  gained  will  be  used  only  for  the  purpose 

stated.  Please  return  the  completed  survey  to  Captain 

Larry  Howell,  ASD/YYEE, 


1.  Would  a  reduction  in  military  aircraft  maintenance  skill 
level  affect  your  decision  to  stay  in  service  and  fly  mill** 
tary  aircraft?  If  so,  how? 

2.  Would  you  anticipate  more  sortie  aborts  or  cancellations 
due  to  the  skill  level  reduction?  If  so,  can  you  estimate 
the  percent  abort  increase  and  identify  what  aircraft  type 
might  be  most  effected? 

3.  Would  you  anticipate  an  increase  in  the  number  of 
quality  control  reworks  if  the  proposed  skill  level  reduction 
should  become  reality?  If  so,  how  much? 

4 .  Do  you  believe  there  would  be  an  increase  in  the  number 
of  aircraft  accidents  due  to  such  a  skill  level  change? 

If  so,  how  much? 

5.  The  proposed  skill  level  reduction  may  result  from 
shorter  enlistments  or  a  rapid  increase  in  military  man¬ 
power  build  up.  If  you  see  this  skill  level  decrease  as 
hazardous  or  detrimental,  can  you  suggest  an  alternative 
plan  or  a  method  to  obtain  and  maintain  the  required 
skilled  personnel? 

6.  What  other  comments  do  you  have  pertaining  to  main¬ 
tenance  skill  levels? 
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RESULTS  OF  OPINION  SURVEY  AS  OF  11  MAY  1979 

1.  Would  a  reduction  in  military  aircraft  maintenance 
skill  level  affect  your  decision  to  stay  in  Bervice  and  fly 
military  aircraft?  If  so,  how? 

No  -  17 

Yes  -  2,  maintenance  is  not  good  enough  now 

2.  Would  you  anticipate  more  sortie  aborts  or  cancellations 
due-  to  the  skill  level  reduction? 

No  -  2 
Yes  -  17 

If  so,  can  you  estimate  the  percent  abort  increase  and 
identify  what  aircraft  type  might  be  most  effected? 

50%  -  12  Fighting  -  17  Some  named  -  2 

25%  -  3  Bombing  -  8 

20%  -  1  Cargo  -  2 

5%  -  1 

3.  Would  you  anticipate  an  increase  in  the  number  of 
quality  control  reworks  if  the  proposed  skill  level 
reduction  should  become  reality?  If  so,  how  much? 

No  -  0  10%  -  1 

Yes  -  19  25%  -  5 

50%  -  10 
100%  -  2 


500%  -  1 


4.  Do  you  believe  there  would  be  an  increase  in  the  number 
of  aircraft  accidents  due  to  such  a  skill,  level  change? 

If  so,  how  much? 

* 

No  -  15  50%  -  1 

Yes  -  4  100%  -  1 

5.  The  proposed  skill  level  reduction  may  result  from 
shortened  enlistments  or  a  rapid  increase  in  military  man¬ 
power  build  up.  If  you  see  this  skill  level  decrease  as 
hazardous  or  detrimental,  can  you  suggest  an  alternative 
plan  or  a  method  to  obtain  and  maintain  the  required 

skilled  personnel? 

% 

No  -  6 

More  pay  for  enlisted  -  1 
Proficiency  pay  -  10 
Commitments  for  training  -  1 

6.  What  other  comments  do  you  have  pertaining  to  main¬ 
tenance  skill  levels? 

Hire  civilian  maintenance 
Contract  maintenance 
Design  simple  aircraft 


